Improving AMR parsing by exploiting the dependency parsing as an auxiliary task

被引:2
|
作者
Wu, Taizhong [1 ]
Zhou, Junsheng [1 ]
Qu, Weiguang [1 ]
Gu, Yanhui [1 ]
Li, Bin [1 ]
Zhong, Huilin [1 ]
Long, Yunfei [2 ]
机构
[1] Nanjing Normal Univ, Sch Comp Sci & Technol, Nanjing, Peoples R China
[2] Univ Essex, Sch Comp Sci & Elect Engn, Colchester, Essex, England
关键词
Abstract meaning representations; Multi-task learning; Dependency-auxiliary AMR parser; Neural network;
D O I
10.1007/s11042-020-09967-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
meaning representations (AMRs) represent sentence semantics as rooted labeled directed acyclic graphs. Though there is a strong correlation between the AMR graph of a sentence and its corresponding dependency tree, the recent neural network AMR parsers do neglect the exploitation of dependency structure information. In this paper, we explore a novel approach to exploiting dependency structures for AMR parsing. Unlike traditional pipeline models, we treat dependency parsing as an auxiliary task for AMR parsing under the multi-task learning framework by sharing neural network parameters and selectively extracting syntactic representation by the attention mechanism. Particularly, to balance the gradients and focus on the AMR parsing task, we present a new dynamical weighting scheme in the loss function. The experimental results on the LDC2015E86 and LDC2017T10 dataset show that our dependency-auxiliary AMR parser significantly outperforms the baseline and its pipeline counterpart, and demonstrate that the neural AMR parsers can be greatly boosted with the help of effective methods of integrating syntax.
引用
收藏
页码:30827 / 30838
页数:12
相关论文
共 50 条
  • [1] Improving AMR parsing by exploiting the dependency parsing as an auxiliary task
    Taizhong Wu
    Junsheng Zhou
    Weiguang Qu
    Yanhui Gu
    Bin Li
    Huilin Zhong
    Yunfei Long
    Multimedia Tools and Applications, 2021, 80 : 30827 - 30838
  • [2] Dependency Graphs and TEITOK: Exploiting Dependency Parsing
    Janssen, Maarten
    COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANGUAGE, PROPOR 2018, 2018, 11122 : 470 - 478
  • [3] AMR Dependency Parsing with a Typed Semantic Algebra
    Groschwitz, Jonas
    Lindemann, Matthias
    Fowlie, Meaghan
    Johnson, Mark
    Koller, Alexander
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 1831 - 1841
  • [4] Auxiliary Tasks to Boost Biaffine Semantic Dependency Parsing
    Candito, Marie
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 2422 - 2429
  • [5] Transition-Based Dependency Parsing Exploiting Supertags
    Ouchi, Hiroki
    Duh, Kevin
    Shindo, Hiroyuki
    Matsumoto, Yuji
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2016, 24 (11) : 2059 - 2068
  • [6] Dependency Parsing
    Nivre, Joakim
    LANGUAGE AND LINGUISTICS COMPASS, 2010, 4 (03):
  • [7] Improving Dependency Parsing by Filtering Linguistic Noise
    Jelinek, Tomas
    TEXT, SPEECH, AND DIALOGUE, TSD 2013, 2013, 8082 : 288 - 294
  • [8] Dependency Parsing
    Carroll, John
    COMPUTATIONAL LINGUISTICS, 2010, 36 (01) : 154 - 156
  • [9] AMR Parsing is Far from Solved: GrAPES, the Granular AMR Parsing Evaluation Suite
    Groschwitz, Jonas
    Cohen, Shay B.
    Donatelli, Lucia
    Fowlie, Meaghan
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 10728 - 10752
  • [10] Task-oriented Dependency Parsing Evaluation Methodology
    Volokh, Alexander
    Neumann, Guenter
    2012 IEEE 13TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI), 2012, : 132 - 137