Weakly-supervised explainable question answering via question aware contrastive learning and adaptive gate mechanism

被引:0
|
作者
Fan, Yue [1 ]
Zhang, Hu [1 ]
Li, Ru [1 ,2 ]
Wang, Yujie [1 ]
Zhang, Guangjun [1 ]
Tan, Hongye [1 ]
Liang, Jiye [1 ,2 ]
机构
[1] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Shanxi, Peoples R China
[2] Shanxi Univ, Key Lab Computat Intelligence & Chinese Informat P, Minist Educ, Taiyuan 030006, Shanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Natural language processing; Explainable question answering; Contrastive learning; Answer-explanation coupling; Adaptive selection gating;
D O I
10.1016/j.ins.2024.121763
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Explainable question answering (XQA) aims to answer a given question as well as provide an explanation. Existing approaches usually give explanatory text with saliency mapping or supervised learning, which still face two challenges: (i) relying on numerous expert-annotated evidence for training, and (ii) low coupling between answers and evidence. In this paper, we propose an XQA method in a weakly supervised manner, namely WSQG, which automatically captures effective remotely supervised signals and mines evidence coupled with answers. Specifically, we propose a multi-granularity evidence distillation method based on a growth- clipping strategy, which obtains the evidence pseudo-labels trade-off informativeness and conciseness. Then, we devise a question-aware contrastive learning objective to enhance the coupling of answers and explanations in fine-tuning, which encourages the model to maximize the similarity of the question and potential evidence from the semantic representation level. In addition, we propose an adaptive selection gate mechanism to reduce the noise introduced by weakly supervised signals for model training. We construct experiments on two unsupervised XQA benchmarks, and the results show that WSQG not only improves the model performance (maximum improvement of 7.6%) but also exhibits better answer-explanation coupling (maximum improvement of 16.2%) compared to the baseline methods.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Hypergraph Transformer: Weakly-Supervised Multi-hop Reasoning for Knowledge-based Visual Question Answering
    Heo, Yu-Jung
    Kim, Eun-Sol
    Choi, Woo Suk
    Zhang, Byoung-Tak
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 373 - 390
  • [22] Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning
    Yang, Sean Bin
    Guo, Chenjuan
    Hu, Jilin
    Yang, Bin
    Tang, Jian
    Jensen, Christian S.
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 2873 - 2885
  • [23] Weakly-Supervised Positional Contrastive Learning: Application to Cirrhosis Classification
    Sarfati, Emma
    Bone, Alexandre
    Rohe, Marc-Michel
    Gori, Pietro
    Bloch, Isabelle
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 227 - 237
  • [24] Semantic-Aware Registration with Weakly-Supervised Learning
    Jin, Zhan
    Xue, Peng
    Zhang, Yuyao
    Cao, Xiaohuan
    Shen, Dinggang
    CANCER PREVENTION THROUGH EARLY DETECTION, CAPTION 2022, 2022, 13581 : 159 - 168
  • [25] Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answering
    You, Chenyu
    Chen, Nuo
    Zou, Yuexian
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 28 - 39
  • [26] Relation-Aware Image Captioning for Explainable Visual Question Answering
    Tseng, Ching-Shan
    Lin, Ying-Jia
    Kao, Hung-Yu
    2022 INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE, TAAI, 2022, : 149 - 154
  • [27] Supervised Transfer Learning for Product Information Question Answering
    Tuan Manh Lai
    Trung Bui
    Lipka, Nedim
    Li, Sheng
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 1109 - 1114
  • [28] Contrastive Video Question Answering via Video Graph Transformer
    Xiao, Junbin
    Zhou, Pan
    Yao, Angela
    Li, Yicong
    Hong, Richang
    Yan, Shuicheng
    Chua, Tat-Seng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13265 - 13280
  • [29] Robust video question answering via contrastive cross-modality representation learning
    Yang, Xun
    Zeng, Jianming
    Guo, Dan
    Wang, Shanshan
    Dong, Jianfeng
    Wang, Meng
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (10)
  • [30] Robust video question answering via contrastive cross-modality representation learning
    Xun YANG
    Jianming ZENG
    Dan GUO
    Shanshan WANG
    Jianfeng DONG
    Meng WANG
    Science China(Information Sciences), 2024, 67 (10) : 211 - 226