Two-Phase Open-Domain Question Answering System

被引:0
|
作者
Prasannan, Vysakh [1 ]
Shemshian, Shahin [1 ]
Gurkan, Arinc [1 ]
Saheer, Lakshmi Babu [1 ]
Oghaz, Mahdi Maktabdar [1 ]
机构
[1] Anglia Ruskin Univ, Cambridge CB1 IPT, England
来源
关键词
Natural language processing; NLP; K-Means; Information retrieval; TF-IDF; Encoder-Decoder; Question answering system;
D O I
10.1007/978-3-031-21441-7_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text-based Internet content is increasing at a very rapid rate day by day. As a result, even the best search engines are struggling to retrieve the exact expected results of users' queries. On many occasions, the users' expected result is embedded and scattered in a number of different documents and conventional search engines are unable to pinpoint it. To address this shortcoming, this study proposes a two-phased question answering system that utilizes a K-means clustering algorithm alongside the T5 deep encoder-decoder model to formulate a concise short answer to users' queries. The proposed system has been trained using the Kaggle QA and SQuAD datasets and achieved the maximum F1-score of 0.564 and a minimum loss of 8.56.
引用
收藏
页码:353 / 358
页数:6
相关论文
共 50 条
  • [21] Adaptive Batch Scheduling for Open-Domain Question Answering
    Choi, Donghyun
    Shin, Myeongcheol
    Kim, Eunggyun
    Shin, Dong Ryeol
    IEEE ACCESS, 2021, 9 : 112097 - 112103
  • [22] RRQA: reconfirmed reader for open-domain question answering
    Shi Li
    Wenqian Zhang
    Applied Intelligence, 2023, 53 : 18420 - 18430
  • [23] Document Gated Reader for Open-Domain Question Answering
    Wang, Bingning
    Yao, Ting
    Zhang, Qi
    Xu, Jingfang
    Tian, Zhixing
    Liu, Kang
    Zhao, Jun
    PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 85 - 94
  • [24] Denoising Distantly Supervised Open-Domain Question Answering
    Lin, Yankai
    Ji, Haozhe
    Liu, Zhiyuan
    Sun, Maosong
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 1736 - 1745
  • [25] Detecting Frozen Phrases in Open-Domain Question Answering
    Yadegari, Mostafa
    Kamalloo, Ehsan
    Rafiei, Davood
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1990 - 1996
  • [26] Leveraging Knowledge Graph for Open-domain Question Answering
    Costa, Jose Ortiz
    Kulkarni, Anagha
    2018 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2018), 2018, : 389 - 394
  • [27] Complementary Evidence Identification in Open-Domain Question Answering
    Mou, Xiangyang
    Yu, Mo
    Chang, Shiyu
    Feng, Yufei
    Zhang, Li
    Su, Hui
    16TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2021), 2021, : 2720 - 2726
  • [28] Dense Passage Retrieval for Open-Domain Question Answering
    Karpukhin, Vladimir
    Oguz, Barlas
    Min, Sewon
    Lewis, Patrick
    Wu, Ledell
    Edunov, Sergey
    Chen, Danqi
    Yih, Wen Tau
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 6769 - 6781
  • [29] A dataset and baselines for sequential open-domain question answering
    Elgohary, Ahmed
    Zhao, Chen
    Boyd-Graber, Jordan
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 1077 - 1083
  • [30] Using clustering approaches to open-domain question answering
    Wu, Youzheng
    Kashioka, Hideki
    Zhao, Jun
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2007, 4394 : 506 - +