Named Entity Correction in Neural Machine Translation Using the Attention Alignment Map

被引:4
|
作者
Lee, Jangwon [1 ,2 ]
Lee, Jungi [3 ]
Lee, Minho [3 ]
Jang, Gil-Jin [2 ,4 ]
机构
[1] SK Holdings C&C, Suwon 13558, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
[3] Kyungpook Natl Univ, Dept Artificial Intelligence, Daegu 41566, South Korea
[4] Kyungpook Natl Univ, Sch Elect Engn, Daegu 41566, South Korea
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 15期
基金
新加坡国家研究基金会;
关键词
neural networks; recurrent neural networks; natural language processing; neural machine translation; named entity recognition; SEQUENCE;
D O I
10.3390/app11157026
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application machine translation; information retrieval; text-to-speech. Neural machine translation (NMT) methods based on various artificial neural network models have shown remarkable performance in diverse tasks and have become mainstream for machine translation currently. Despite the recent successes of NMT applications, a predefined vocabulary is still required, meaning that it cannot cope with out-of-vocabulary (OOV) or rarely occurring words. In this paper, we propose a postprocessing method for correcting machine translation outputs using a named entity recognition (NER) model to overcome the problem of OOV words in NMT tasks. We use attention alignment mapping (AAM) between the named entities of input and output sentences, and mistranslated named entities are corrected using word look-up tables. The proposed method corrects named entities only, so it does not require retraining of existing NMT models. We carried out translation experiments on a Chinese-to-Korean translation task for Korean historical documents, and the evaluation results demonstrated that the proposed method improved the bilingual evaluation understudy (BLEU) score by 3.70 from the baseline.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Attention Calibration for Transformer in Neural Machine Translation
    Lu, Yu
    Zeng, Jiali
    Zhang, Jiajun
    Wu, Shuangzhi
    Li, Mu
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1 (ACL-IJCNLP 2021), 2021, : 1288 - 1298
  • [32] Parallel Attention Mechanisms in Neural Machine Translation
    Medina, Julian Richard
    Kalita, Jugal
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 547 - 552
  • [33] Improving Named Entity Recognition using Bilingual Constraints and Word Alignment
    Dao, An T.
    Truong, Thinh H.
    Nguyen, Long
    Dinh, Dien
    2018 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2018), 2018, 435
  • [34] Improving neural machine translation with sentence alignment learning
    Shi, Xuewen
    Huang, Heyan
    Jian, Ping
    Tang, Yi-Kun
    NEUROCOMPUTING, 2021, 420 : 15 - 26
  • [35] Named entity recognition for Manipuri using support vector machine
    Center for Development of Advanced Computing, Gulmohar Cross Road No 9, Juhu, Mumbai-400049, India
    不详
    不详
    PACLIC 23 - Proc. 23rd Pacific Asia Conf. Lang. Inf. Comput., 2009, (811-818):
  • [36] Named Entity Recognition in Crime Using Machine Learning Approach
    Shabat, Hafedh
    Omar, Nazlia
    Rahem, Khmael
    INFORMATION RETRIEVAL TECHNOLOGY, AIRS 2014, 2014, 8870 : 280 - 288
  • [37] Resolving Ambiguities in Named Entity Recognition Using Machine Learning
    Bhandari, Nitin
    Chowdri, Ritika
    Singh, Harmeet
    Qureshi, Salim Raza
    2017 INTERNATIONAL CONFERENCE ON NEXT GENERATION COMPUTING AND INFORMATION SYSTEMS (ICNGCIS), 2017, : 159 - 163
  • [38] Named entity recognition using hybrid machine learning approach
    Chiong, Raymond
    Wei, Wang
    PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, VOLS 1 AND 2, 2006, : 578 - 583
  • [39] Named entity recognition in crime using machine learning approach
    Shabat, Hafedh (h2005_ali@yahoo.com), 1600, Springer Verlag (8870):
  • [40] Named Entity Recognition Algorithm for iBISDS Using Neural Network
    Wang, Ning
    Issa, Raja R. A.
    Anumba, Chimay J.
    CONSTRUCTION RESEARCH CONGRESS 2022: COMPUTER APPLICATIONS, AUTOMATION, AND DATA ANALYTICS, 2022, : 521 - 529