Identifying Well-formed Natural Language Questions

被引:0
|
作者
Faruqui, Manaal [1 ]
Das, Dipanjan [1 ]
机构
[1] Google AI Language, Mountain View, CA 94043 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Understanding search queries is a hard problem as it involves dealing with "word salad" text ubiquitously issued by users. However, if a query resembles a well-formed question, a natural language processing pipeline is able to perform more accurate interpretation, thus reducing downstream compounding errors. Hence, identifying whether or not a query is well formed can enhance query understanding. Here, we introduce a new task of identifying a well-formed natural language question. We construct and release a dataset of 25,100 publicly available questions classified into well-formed and non-wellformed categories and report an accuracy of 70.7% on the test set. We also show that our classifier can be used to improve the performance of neural sequence-to-sequence models for generating questions for reading comprehension.
引用
收藏
页码:798 / 803
页数:6
相关论文
共 50 条
  • [41] Well-formed decompositions of generalized additive independence models
    Grabisch, Michel
    Labreuche, Christophe
    Ridaoui, Mustapha
    ANNALS OF OPERATIONS RESEARCH, 2022, 312 (02) : 827 - 852
  • [42] Flexible query techniques for well-formed XML documents
    Damiani, E
    Tanca, L
    KES'2000: FOURTH INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED INTELLIGENT ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, VOLS 1 AND 2, PROCEEDINGS, 2000, : 708 - 711
  • [43] Parametric stochastic well-formed nets and compositional modelling
    Ballarini, P
    Donatelli, S
    Franceschinis, G
    APPLICATION AND THEORY OF PETRI NETS 2000, PROCEEDINGS, 2000, 1825 : 43 - 62
  • [44] XPEV: A storage model for well-formed XML documents
    Qin, J
    Zhao, SM
    Yang, SQ
    Dou, WH
    FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, PT 1, PROCEEDINGS, 2005, 3613 : 360 - 369
  • [45] Generating Label Cohesive and Well-Formed Adversarial Claims
    Atanasova, Pepa
    Wright, Dustin
    Augenstein, Isabelle
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 3168 - 3177
  • [46] ELEMENTARY STUDENTS COMPREHENSION OF ANAPHORA IN WELL-FORMED STORIES
    JOHNSON, BE
    JOHNSON, DD
    JOURNAL OF EDUCATIONAL RESEARCH, 1985, 78 (04): : 221 - 223
  • [47] Mathematical and Musical Properties of Pairwise Well-Formed Scales
    Clampitt, David
    MATHEMATICS AND COMPUTATION IN MUSIC, 2009, 37 : 464 - 468
  • [48] Parallel algorithms for listing well-formed parentheses strings
    Vajnovszki, Vincent
    Pallo, Jean
    Parallel Processing Letters, 1998, 8 (01): : 19 - 28
  • [49] CONSTRUCTION OF WELL-FORMED PETRI NETS FROM STANDARD SUBNETS
    DRUZHININ, VA
    YUDITSKII, SA
    AUTOMATION AND REMOTE CONTROL, 1992, 53 (12) : 1922 - 1927
  • [50] The classification of smooth well-formed Fano weighted complete intersections
    Ovcharenko, Mikhail
    INTERNATIONAL JOURNAL OF MATHEMATICS, 2023, 34 (11)