Multi-Hop Reasoning Question Generation and Its Application

被引:7
|
作者
Yu, Jianxing [1 ,2 ]
Su, Qinliang [1 ]
Quan, Xiaojun [1 ]
Yin, Jian [1 ]
机构
[1] Sun Yat Sen Univ, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510006, Peoples R China
[2] Pazhou Lab, Guangzhou 510330, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Multi-hop question; question generation (QG); reasoning chain; adaptive QG model; machine reading comprehension;
D O I
10.1109/TKDE.2021.3073227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article focuses on the topic of multi-hop question generation (QG), which aims to generate the questions requiring multi-hop reasoning skills by understanding the semantics of the given text fully. These questions not only have valid syntax but also need to be logically correlated to the answers. Concretely, we first design a basic QG model based on the sequence-to-sequence framework. In order to improve the syntactic quality of the results, we customize several techniques to regularize the model's output. We then extract a reasoning chain heuristically from the given text and use the evidential relations to promote the logical correlations of the results. Considering that different samples have their own characteristics on the aspects of text contextual structure, the type of question, and logical correlation, it is difficult for such a one-size-fits-all model to generate the best results flexibly. Thus, we propose a new adaptive meta-learner to optimize the basic QG model according to the specific characteristic of the evaluated case. Each case and its similar samples are viewed as a pseudo-QG task. The similar structural contexts contained in the same task can be used as guidance to fine-tune the model robustly and produce the optimal results accordingly. Since each sample contains the text, question, and answer, with unknown semantic correlations among them, we propose a data-driven multi-level recognizer to measure the similarity of such structured inputs. The experimental results on two typical data sets in various domains show the effectiveness of the proposed approach. Moreover, we apply the generated results to the task of machine reading comprehension and achieve significant performance improvements. That demonstrates the capacity of multi-hop question generation in facilitating real-world applications.
引用
收藏
页码:725 / 740
页数:16
相关论文
共 50 条
  • [41] LEGO: Latent Execution-Guided Reasoning for Multi-Hop Question Answering on Knowledge Graphs
    Ren, Hongyu
    Dai, Hanjun
    Dai, Bo
    Chen, Xinyun
    Yasunaga, Michihiro
    Sun, Haitian
    Schuurmans, Dale
    Leskovec, Jure
    Zhou, Denny
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [42] GaussianPath:A Bayesian Multi-Hop Reasoning Framework for Knowledge Graph Reasoning
    Wan, Guojia
    Du, Bo
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4393 - 4401
  • [43] Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability
    Lv, Xin
    Cao, Yixin
    Hou, Lei
    Li, Juanzi
    Liu, Zhiyuan
    Zhang, Yichi
    Dai, Zelin
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 8899 - 8911
  • [44] Improved Multi-hop Reasoning Through Sampling and Aggregating
    Luo, Mengyu
    Chen, Jianxia
    Yan, Qi
    Jiang, Gaohang
    Dong, Shi
    Xiao, Liang
    Huang, Zhongwei
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT I, 2024, 15016 : 131 - 146
  • [45] Dynamically Fused Graph Network for Multi-hop Reasoning
    Qiu, Lin
    Xiao, Yunxuan
    Qu, Yanru
    Zhou, Hao
    Li, Lei
    Zhang, Weinan
    Yu, Yong
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 6140 - 6150
  • [46] Multi-Hop Knowledge Graph Reasoning with Reward Shaping
    Lin, Xi Victoria
    Socher, Richard
    Xiong, Caiming
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3243 - 3253
  • [47] Understanding Dataset Design Choices for Multi-hop Reasoning
    Chen, Jifan
    Durrett, Greg
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 4026 - 4032
  • [48] Compositional Questions Do Not Necessitate Multi-hop Reasoning
    Min, Sewon
    Wallace, Eric
    Singh, Sameer
    Gardner, Matt
    Hajishirzi, Hannaneh
    Zettlemoyer, Luke
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 4249 - 4257
  • [49] Interpretable multi-hop knowledge reasoning for gastrointestinal disease
    Wang, Dujuan
    Wang, Xinwei
    Abedin, Mohammad Zoynul
    Wang, Sutong
    Yin, Yunqiang
    ANNALS OF OPERATIONS RESEARCH, 2023,
  • [50] CogKR: Cognitive Graph for Multi-Hop Knowledge Reasoning
    Du, Zhengxiao
    Zhou, Chang
    Yao, Jiangchao
    Tu, Teng
    Cheng, Letian
    Yang, Hongxia
    Zhou, Jingren
    Tang, Jie
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1283 - 1295