Answer Validation through Textual Entailment

被引:0
|
作者
Pakray, Partha [1 ]
机构
[1] Univ Jadavpur, Dept Comp Sci & Engn, Kolkata, India
关键词
Answer Validation Exercise (AVE); Textual Entailment (TE); Named Entity (NE); Chunk Boundary; Syntactic Similarity; Question Type;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ongoing research work on an Answer Validation System (AV) based on Textual Entailment and Question Answering has been presented. A number of answer validation modules have been developed based on Textual Entailment, Named Entity Recognition, Question-Answer type analysis, Chunk boundary module and Syntactic similarity module. These answer validation modules have been integrated using a voting technique. We combine the question and the answer into the Hypothesis (H) and the Supporting Text as Text (T) to identify the entailment relation as either "VALIDATED" or "REJECTED". The important features in the lexical Textual Entailment module are: WordNet based unigram match, bi-gram match and skip-gram. In the syntactic similarity module, the important features used are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. The precision, recall and f-score of the integrated AV system on the AVE 2008 English annotated test set have been observed as 0.66, 0.65 and 0.65 respectively that outperforms the best performing system at AVE 2008 in terms of f-score.
引用
收藏
页码:324 / 329
页数:6
相关论文
共 50 条
  • [1] Answer Validation Using Textual Entailment
    Pakray, Partha
    Gelbukh, Alexander
    Bandyopadhyay, Sivaji
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, PT II, 2011, 6609 : 353 - +
  • [2] Detecting expected answer relations through textual entailment
    Negri, Matteo
    Kouylekov, Milen
    Magnini, Bernardo
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2008, 4919 : 532 - +
  • [3] TE4AV: Textual Entailment for Answer Validation
    Ferrandez, Oscar
    Munoz, Rafael
    Palomar, Manuel
    IEEE NLP-KE 2008: PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING, 2008, : 281 - 288
  • [4] Using Recognizing Textual Entailment as a Core Engine for Answer Validation
    Wang, Rui
    Neumann, Guenter
    ADVANCES IN MULTILINGUAL AND MULTIMODAL INFORMATION RETRIEVAL, 2008, 5152 : 387 - +
  • [5] Short-answer grading using textual entailment
    Basak, Rohini
    Naskar, Sudip Kumar
    Gelbukh, Alexander
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (05) : 4909 - 4919
  • [6] Textual Entailment for Effective Triple Validation in Object Prediction
    Garcia-Silva, Andres
    Berrio, Cristian
    Gomez-Perez, Jose Manuel
    SEMANTIC WEB, ISWC 2023, PART I, 2023, 14265 : 80 - 100
  • [7] A STUDY OF TEXTUAL ENTAILMENT
    Rus, Vasile
    McCarthy, Philip M.
    McNamara, Danielle S.
    Graesser, Arthur C.
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2008, 17 (04) : 659 - 685
  • [8] Translators in Textual Entailment
    Javier Castillo, Julio
    DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE, 2010, 79 : 193 - 196
  • [9] Textual Entailment by Generality
    Pais, Sebastiao
    Dias, Gael
    Wegrzyn-Wolska, Katarzyna
    Mahl, Robert
    Jouvelot, Pierre
    COMPUTATIONAL LINGUISTICS AND RELATED FIELDS, 2011, 27 : 258 - 266
  • [10] A study on textual entailment
    Rus, V
    Graesser, A
    McCarthy, PM
    Lin, KI
    ICTAI 2005: 17TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2005, : 326 - 333