Distilling the Evidence to Augment Fact Verification Models

被引:0
|
作者
Portelli, Beatrice [1 ]
Zhao, Jason [2 ]
Schuster, Tal [2 ]
Serra, Giuseppe [1 ]
Santus, Enrico [2 ,3 ]
机构
[1] Univ Udine, Udine, Italy
[2] MIT, CSAIL, Cambridge, MA 02139 USA
[3] Bayer, Decis Sci & Adv Analyt MAPV & RA, Leverkusen, Germany
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The alarming spread of fake news in social media, together with the impossibility of scaling manual fact verification, motivated the development of natural language processing techniques to automatically verify the veracity of claims. Most approaches perform a claim-evidence classification without providing any insights about why the claim is trustworthy or not. We propose, instead, a model-agnostic framework that consists of two modules: (1) a span extractor, which identifies the crucial information connecting claim and evidence; and (2) a classifier that combines claim, evidence, and the extracted spans to predict the veracity of the claim We show that the spans are informative for the classifier, improving performance and robustness. Tested on several state-of-the-art models over the FEVER dataset, the enhanced classifiers consistently achieve higher accuracy while also showing reduced sensitivity to artifacts in the claims.
引用
收藏
页码:47 / 51
页数:5
相关论文
共 50 条
  • [1] Evidence Distilling for Fact Extraction and Verification
    Lin, Yang
    Huang, Pengyu
    Lai, Yuxuan
    Feng, Yansong
    Zhao, Dongyan
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 211 - 222
  • [2] Towards Debiasing Fact Verification Models
    Schuster, Tal
    Shah, Darsh J.
    Yeo, Yun Jie Serene
    Filizzola, Daniel
    Santus, Enrico
    Barzilay, Regina
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 3419 - 3425
  • [3] Distilling Programs for Verification
    Hamilton, G. W.
    ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2007, 190 (04) : 17 - 32
  • [4] UNIFEE: Unified Evidence Extraction for Fact Verification
    Hu, Nan
    Wu, Zirui
    Lai, Yuxuan
    Zhang, Chen
    Feng, Yansong
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1150 - 1160
  • [5] A syntactic evidence network model for fact verification
    Chen, Zhendong
    Hui, Siu Cheung
    Zhuang, Fuzhen
    Liao, Lejian
    Jia, Meihuizi
    Li, Jiaqi
    Huang, Heyan
    NEURAL NETWORKS, 2024, 178
  • [6] GERE: Generative Evidence Retrieval for Fact Verification
    Chen, Jiangui
    Zhang, Ruqing
    Guo, Jiafeng
    Fan, Yixing
    Cheng, Xueqi
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2184 - 2189
  • [7] Enhancing Structured Evidence Extraction for Fact Verification
    Wu, Zirui
    Hu, Nan
    Feng, Yansong
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 6631 - 6641
  • [8] EvidenceNet: Evidence Fusion Network for Fact Verification
    Chen, Zhendong
    Hui, Siu Cheung
    Zhuang, Fuzhen
    Liao, Lejian
    Li, Fei
    Jia, Meihuizi
    Li, Jiaqi
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2636 - 2645
  • [9] Hierarchical Evidence Set Modeling for Automated Fact Extraction and Verification
    Subramanian, Shyam
    Lee, Kyumin
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 7798 - 7809
  • [10] From Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification
    Zhang, Hengran
    Zhang, Ruqing
    Guo, Jiafeng
    de Rijke, Maarten
    Fan, Yixing
    Cheng, Xueqi
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS - EMNLP 2023, 2023, : 6373 - 6384