Computer Science > Computation and Language
arXiv:2203.12990 (cs)
[Submitted on 24 Mar 2022]
Title:Generating Scientific Claims for Zero-Shot Scientific Fact Checking
Authors:Dustin Wright,David Wadden,Kyle Lo,Bailey Kuehl,Arman Cohan,Isabelle Augenstein,Lucy Lu Wang
View a PDF of the paper titled Generating Scientific Claims for Zero-Shot Scientific Fact Checking, by Dustin Wright and 6 other authors
View PDFAbstract:Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim generation, the task of generating one or more atomic and verifiable claims from scientific sentences, and demonstrate its usefulness in zero-shot fact checking for biomedical claims. We propose CLAIMGEN-BART, a new supervised method for generating claims supported by the literature, as well as KBIN, a novel method for generating claim negations. Additionally, we adapt an existing unsupervised entity-centric method of claim generation to biomedical claims, which we call CLAIMGEN-ENTITY. Experiments on zero-shot fact checking demonstrate that both CLAIMGEN-ENTITY and CLAIMGEN-BART, coupled with KBIN, achieve up to 90% performance of fully supervised models trained on manually annotated claims and evidence. A rigorous evaluation study demonstrates significant improvement in generated claim and negation quality over existing baselines
| Comments: | Accepted to ACL 2022; 13 pages, 3 figures, 8 tables |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2203.12990 [cs.CL] |
| (orarXiv:2203.12990v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2203.12990 arXiv-issued DOI via DataCite |
Full-text links:
Access Paper:
- View PDF
- TeX Source
- Other Formats
View a PDF of the paper titled Generating Scientific Claims for Zero-Shot Scientific Fact Checking, by Dustin Wright and 6 other authors
References & Citations
Bookmark
Bibliographic and Citation Tools
Bibliographic Explorer(What is the Explorer?)
Connected Papers(What is Connected Papers?)
Litmaps(What is Litmaps?)
scite Smart Citations(What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv(What is alphaXiv?)
CatalyzeX Code Finder for Papers(What is CatalyzeX?)
DagsHub(What is DagsHub?)
Gotit.pub(What is GotitPub?)
Hugging Face(What is Huggingface?)
Papers with Code(What is Papers with Code?)
ScienceCast(What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower(What are Influence Flowers?)
CORE Recommender(What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community?Learn more about arXivLabs.