Identifying Well-formed Natural Language Questions

被引:0
|
作者
Faruqui, Manaal [1 ]
Das, Dipanjan [1 ]
机构
[1] Google AI Language, Mountain View, CA 94043 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Understanding search queries is a hard problem as it involves dealing with "word salad" text ubiquitously issued by users. However, if a query resembles a well-formed question, a natural language processing pipeline is able to perform more accurate interpretation, thus reducing downstream compounding errors. Hence, identifying whether or not a query is well formed can enhance query understanding. Here, we introduce a new task of identifying a well-formed natural language question. We construct and release a dataset of 25,100 publicly available questions classified into well-formed and non-wellformed categories and report an accuracy of 70.7% on the test set. We also show that our classifier can be used to improve the performance of neural sequence-to-sequence models for generating questions for reading comprehension.
引用
收藏
页码:798 / 803
页数:6
相关论文
共 50 条
  • [1] Identifying well-formed biomedical phrases in MEDLINE® text
    Kim, Won
    Yeganova, Lana
    Comeau, Donald C.
    Wilbur, W. John
    JOURNAL OF BIOMEDICAL INFORMATICS, 2012, 45 (06) : 1035 - 1041
  • [2] Coherence and sameness in well-formed and pairwise well-formed scales
    Carey, Norman
    JOURNAL OF MATHEMATICS AND MUSIC, 2007, 1 (02) : 79 - 98
  • [3] The Web is not well-formed
    Schreiber, G
    IEEE INTELLIGENT SYSTEMS, 2002, 17 (02): : 78 - 78
  • [4] A high level language for structural relations in well-formed nets
    Capra, L
    De Pierro, M
    Franceschinis, G
    APPLICATIONS AND THEORY OF PETRI NETS 2005, PROCEEDINGS, 2005, 3536 : 168 - 187
  • [5] Towards natural language processing: A well-formed substring table approach to understanding garden path sentence
    Du Jia-li
    Yu Ping-fang
    2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS PROCEEDINGS (DBTA), 2010,
  • [6] ASPECTS OF WELL-FORMED SCALES
    CAREY, N
    CLAMPITT, D
    MUSIC THEORY SPECTRUM, 1989, 11 (02) : 187 - 206
  • [7] ROSS PARADOX AND WELL-FORMED CODICES
    STENIUS, E
    THEORIA, 1982, 48 : 49 - 77
  • [8] Well-formed set representations of solids
    Shapiro, V
    INTERNATIONAL JOURNAL OF COMPUTATIONAL GEOMETRY & APPLICATIONS, 1999, 9 (02) : 125 - 150
  • [9] Transformations for Pairwise Well-Formed Modes
    Noll, Thomas
    Clampitt, David
    MATHEMATICS AND COMPUTATION IN MUSIC (MCM 2022), 2022, : 140 - 152
  • [10] Pairwise Well-Formed Modes and Transformations
    Clampitt, David
    Noll, Thomas
    MATHEMATICS AND COMPUTATION IN MUSIC, MCM 2017, 2017, 10527 : 26 - 37