Answer Validation through Textual Entailment

被引:0
|
作者
Pakray, Partha [1 ]
机构
[1] Univ Jadavpur, Dept Comp Sci & Engn, Kolkata, India
关键词
Answer Validation Exercise (AVE); Textual Entailment (TE); Named Entity (NE); Chunk Boundary; Syntactic Similarity; Question Type;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Ongoing research work on an Answer Validation System (AV) based on Textual Entailment and Question Answering has been presented. A number of answer validation modules have been developed based on Textual Entailment, Named Entity Recognition, Question-Answer type analysis, Chunk boundary module and Syntactic similarity module. These answer validation modules have been integrated using a voting technique. We combine the question and the answer into the Hypothesis (H) and the Supporting Text as Text (T) to identify the entailment relation as either "VALIDATED" or "REJECTED". The important features in the lexical Textual Entailment module are: WordNet based unigram match, bi-gram match and skip-gram. In the syntactic similarity module, the important features used are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. The precision, recall and f-score of the integrated AV system on the AVE 2008 English annotated test set have been observed as 0.66, 0.65 and 0.65 respectively that outperforms the best performing system at AVE 2008 in terms of f-score.
引用
收藏
页码:324 / 329
页数:6
相关论文
共 50 条
  • [41] Annotation Game for Textual Entailment Evaluation
    Neverilova, Zuzana
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, CICLING 2014, PT I, 2014, 8403 : 340 - 350
  • [42] Acquiring Data for Textual Entailment Recognition
    Neverilova, Zuzana
    RASLAN 2013: RECENT ADVANCES IN SLAVONIC NATURAL LANGUAGE PROCESSING, 2013, : 29 - 37
  • [43] Building a Greek corpus for Textual Entailment
    Marzelou, Evi
    Zourari, Maria
    Giouli, Voula
    Piperidis, Stelios
    SIXTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, LREC 2008, 2008, : 1680 - 1686
  • [44] Recognizing Textual Entailment and Paraphrases in Portuguese
    Rocha, Gil
    Cardoso, Henrique Lopes
    PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2017), 2017, 10423 : 868 - 879
  • [45] The PASCAL recognising textual entailment challenge
    Dagan, Ido
    Glickman, Oren
    Magnini, Bernardo
    MACHINE LEARNING CHALLENGES: EVALUATING PREDICTIVE UNCERTAINTY VISUAL OBJECT CLASSIFICATION AND RECOGNIZING TEXTUAL ENTAILMENT, 2006, 3944 : 177 - 190
  • [46] A Survey of Paraphrasing and Textual Entailment Methods
    Androutsopoulos, Ion
    Malakasiotis, Prodromos
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2010, 38 : 135 - 187
  • [47] Construction of chinese textual entailment corpus
    Kang, Shiyong
    ICIC Express Letters, Part B: Applications, 2013, 4 (04): : 1095 - 1100
  • [48] Compositional Evaluation on Japanese Textual Entailment and Similarity
    Yanaka, Hitomi
    Mineshima, Koji
    arXiv, 2022,
  • [49] Design and realization of a modular architecture for textual entailment
    Pado, Sebastian
    Noh, Tae-Gil
    Stern, Asher
    Wang, Rui
    Zanoli, Roberto
    NATURAL LANGUAGE ENGINEERING, 2015, 21 (02) : 167 - 200
  • [50] Recognizing textual entailment via atomic propositions
    Akhmatova, Elena
    Molla, Diego
    MACHINE LEARNING CHALLENGES: EVALUATING PREDICTIVE UNCERTAINTY VISUAL OBJECT CLASSIFICATION AND RECOGNIZING TEXTUAL ENTAILMENT, 2006, 3944 : 385 - 403