Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning

Pradeesh Parameswaran; Andrew Trotman; Veronica Liesaputra; David Eyers

Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning

Pradeesh Parameswaran, Andrew Trotman, Veronica Liesaputra, David Eyers

Correct Metadata for

Use this form to create a GitHub issue with structured data describing the correction. You will need a GitHub account. Once you create that issue, the correction will be reviewed by a staff member.

⚠️ Mobile Users: Submitting this form to create a new issue will only work with github.com, not the GitHub Mobile app.

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>. You may use ... for bold, ... for italic, ... for underline, <sc>...</sc> for small-caps, <tt>...<tt> for typewriter text, <url>...</url> for URLs, <a href=...> for hyperlinks, and <par/> for paragraph breaks.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

We describe our methods for automatically grading the level of clinical evidence in medical papers, as part of the ALTA 2021 shared task. We use a combination of transfer learning and a hand-crafted, feature-based classifier. Our system (ï¿1⁄2orangutanV3ï¿1⁄2) obtained an accuracy score of 0.4918, which placed third in the leaderboard. From our failure analysis, we find that our classification techniques do not appropriately handle cases when the conclusions of across the medical papers are themselves inconclusive. We believe that this shortcoming can be overcomeï¿1⁄2thus improving the classification accuracyï¿1⁄2by incorporating document similarity techniques.

Anthology ID:: 2021.alta-1.24
Volume:: Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association
Month:: December
Year:: 2021
Address:: Online
Editors:: Afshin Rahimi, William Lane, Guido Zuccon
Venues:: ALTA | WS
SIG:
Publisher:: Australasian Language Technology Association
Note:
Pages:: 205–212
Language:
URL:: https://aclanthology.org/2021.alta-1.24/
DOI:
Bibkey:
Cite (ACL):: Pradeesh Parameswaran, Andrew Trotman, Veronica Liesaputra, and David Eyers. 2021. Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning. In Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association, pages 205–212, Online. Australasian Language Technology Association.
Cite (Informal):: Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning (Parameswaran et al., ALTA 2021)
Copy Citation:
PDF:: https://aclanthology.org/2021.alta-1.24.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{parameswaran-etal-2021-quick,
 title = "Quick, get me a Dr. {BERT}: Automatic Grading of Evidence using Transfer Learning",
 author = "Parameswaran, Pradeesh and
 Trotman, Andrew and
 Liesaputra, Veronica and
 Eyers, David",
 editor = "Rahimi, Afshin and
 Lane, William and
 Zuccon, Guido",
 booktitle = "Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association",
 month = dec,
 year = "2021",
 address = "Online",
 publisher = "Australasian Language Technology Association",
 url = "https://aclanthology.org/2021.alta-1.24/",
 pages = "205--212",
 abstract = {We describe our methods for automatically grading the level of clinical evidence in medical papers, as part of the ALTA 2021 shared task. We use a combination of transfer learning and a hand-crafted, feature-based classifier. Our system ({\"i}{\textquestiondown}{\textonehalf}orangutanV3{\"i}{\textquestiondown}{\textonehalf}) obtained an accuracy score of 0.4918, which placed third in the leaderboard. From our failure analysis, we find that our classification techniques do not appropriately handle cases when the conclusions of across the medical papers are themselves inconclusive. We believe that this shortcoming can be overcome{\"i}{\textquestiondown}{\textonehalf}thus improving the classification accuracy{\"i}{\textquestiondown}{\textonehalf}by incorporating document similarity techniques.}
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="parameswaran-etal-2021-quick">
 <titleInfo>
 <title>Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning</title>
 </titleInfo>
 <name type="personal">
 <namePart type="given">Pradeesh</namePart>
 <namePart type="family">Parameswaran</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">author</roleTerm>
 </role>
 </name>
 <name type="personal">
 <namePart type="given">Andrew</namePart>
 <namePart type="family">Trotman</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">author</roleTerm>
 </role>
 </name>
 <name type="personal">
 <namePart type="given">Veronica</namePart>
 <namePart type="family">Liesaputra</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">author</roleTerm>
 </role>
 </name>
 <name type="personal">
 <namePart type="given">David</namePart>
 <namePart type="family">Eyers</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">author</roleTerm>
 </role>
 </name>
 <originInfo>
 <dateIssued>2021-12</dateIssued>
 </originInfo>
 <typeOfResource>text</typeOfResource>
 <relatedItem type="host">
 <titleInfo>
 <title>Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association</title>
 </titleInfo>
 <name type="personal">
 <namePart type="given">Afshin</namePart>
 <namePart type="family">Rahimi</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">editor</roleTerm>
 </role>
 </name>
 <name type="personal">
 <namePart type="given">William</namePart>
 <namePart type="family">Lane</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">editor</roleTerm>
 </role>
 </name>
 <name type="personal">
 <namePart type="given">Guido</namePart>
 <namePart type="family">Zuccon</namePart>
 <role>
 <roleTerm authority="marcrelator" type="text">editor</roleTerm>
 </role>
 </name>
 <originInfo>
 <publisher>Australasian Language Technology Association</publisher>
 <place>
 <placeTerm type="text">Online</placeTerm>
 </place>
 </originInfo>
 <genre authority="marcgt">conference publication</genre>
 </relatedItem>
 <abstract>We describe our methods for automatically grading the level of clinical evidence in medical papers, as part of the ALTA 2021 shared task. We use a combination of transfer learning and a hand-crafted, feature-based classifier. Our system (ï¿1⁄2orangutanV3ï¿1⁄2) obtained an accuracy score of 0.4918, which placed third in the leaderboard. From our failure analysis, we find that our classification techniques do not appropriately handle cases when the conclusions of across the medical papers are themselves inconclusive. We believe that this shortcoming can be overcomeï¿1⁄2thus improving the classification accuracyï¿1⁄2by incorporating document similarity techniques.</abstract>
 <identifier type="citekey">parameswaran-etal-2021-quick</identifier>
 <location>
 <url>https://aclanthology.org/2021.alta-1.24/</url>
 </location>
 <part>
 <date>2021-12</date>
 <extent unit="page">
 <start>205</start>
 <end>212</end>
 </extent>
 </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning
%A Parameswaran, Pradeesh
%A Trotman, Andrew
%A Liesaputra, Veronica
%A Eyers, David
%Y Rahimi, Afshin
%Y Lane, William
%Y Zuccon, Guido
%S Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association
%D 2021
%8 December
%I Australasian Language Technology Association
%C Online
%F parameswaran-etal-2021-quick
%X We describe our methods for automatically grading the level of clinical evidence in medical papers, as part of the ALTA 2021 shared task. We use a combination of transfer learning and a hand-crafted, feature-based classifier. Our system (ï¿1⁄2orangutanV3ï¿1⁄2) obtained an accuracy score of 0.4918, which placed third in the leaderboard. From our failure analysis, we find that our classification techniques do not appropriately handle cases when the conclusions of across the medical papers are themselves inconclusive. We believe that this shortcoming can be overcomeï¿1⁄2thus improving the classification accuracyï¿1⁄2by incorporating document similarity techniques.
%U https://aclanthology.org/2021.alta-1.24/
%P 205-212

Download as File

Markdown (Informal)

[Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning](https://aclanthology.org/2021.alta-1.24/) (Parameswaran et al., ALTA 2021)

Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning (Parameswaran et al., ALTA 2021)

ACL

Pradeesh Parameswaran, Andrew Trotman, Veronica Liesaputra, and David Eyers. 2021. Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning. In Proceedings of the 19th Annual Workshop of the Australasian Language Technology Association, pages 205–212, Online. Australasian Language Technology Association.