Named Entity Correction in Neural Machine Translation Using the Attention Alignment Map

被引:4
|
作者
Lee, Jangwon [1 ,2 ]
Lee, Jungi [3 ]
Lee, Minho [3 ]
Jang, Gil-Jin [2 ,4 ]
机构
[1] SK Holdings C&C, Suwon 13558, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
[3] Kyungpook Natl Univ, Dept Artificial Intelligence, Daegu 41566, South Korea
[4] Kyungpook Natl Univ, Sch Elect Engn, Daegu 41566, South Korea
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 15期
基金
新加坡国家研究基金会;
关键词
neural networks; recurrent neural networks; natural language processing; neural machine translation; named entity recognition; SEQUENCE;
D O I
10.3390/app11157026
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application machine translation; information retrieval; text-to-speech. Neural machine translation (NMT) methods based on various artificial neural network models have shown remarkable performance in diverse tasks and have become mainstream for machine translation currently. Despite the recent successes of NMT applications, a predefined vocabulary is still required, meaning that it cannot cope with out-of-vocabulary (OOV) or rarely occurring words. In this paper, we propose a postprocessing method for correcting machine translation outputs using a named entity recognition (NER) model to overcome the problem of OOV words in NMT tasks. We use attention alignment mapping (AAM) between the named entities of input and output sentences, and mistranslated named entities are corrected using word look-up tables. The proposed method corrects named entities only, so it does not require retraining of existing NMT models. We carried out translation experiments on a Chinese-to-Korean translation task for Korean historical documents, and the evaluation results demonstrated that the proposed method improved the bilingual evaluation understudy (BLEU) score by 3.70 from the baseline.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Neural Machine Translation With Explicit Phrase Alignment
    Zhang, Jiacheng
    Luan, Huanbo
    Sun, Maosong
    Zhai, Feifei
    Xu, Jingfang
    Liu, Yang
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 1001 - 1010
  • [22] Simultaneous Neural Machine Translation with Prefix Alignment
    Kano, Yasumasa
    Sudoh, Katsuhito
    Nakamura, Satoshi
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022), 2022, : 22 - 31
  • [23] Entity Alignment of Knowledge Graph by Joint Graph Attention and Translation Representation
    Jiang, Shixian
    Nie, Tiezheng
    Shen, Derong
    Kou, Yue
    Yu, Ge
    WEB INFORMATION SYSTEMS AND APPLICATIONS (WISA 2021), 2021, 12999 : 347 - 358
  • [24] Neural Machine Translation with Error Correction
    Song, Kaitao
    Tan, Xu
    Lu, Jianfeng
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3891 - 3897
  • [25] Improved Named Entity Recognition using Machine Translation-based Cross-lingual Information
    Dandapat, Sandipan
    Way, Andy
    COMPUTACION Y SISTEMAS, 2016, 20 (03): : 495 - 504
  • [26] Resolving Named Entity Unknown Word in Chinese-Vietnamese Machine Translation
    Phuoc Tran
    Dien Dinh
    Linh Tran
    KNOWLEDGE AND SYSTEMS ENGINEERING (KSE 2013), VOL 2, 2014, 245 : 273 - 284
  • [27] Entity Highlight Generation as Statistical and Neural Machine Translation
    Huang, Jizhou
    Sun, Yaming
    Zhang, Wei
    Wang, Haifeng
    Liu, Ting
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (10) : 1860 - 1872
  • [28] Sparse and Constrained Attention for Neural Machine Translation
    Malaviya, Chaitanya
    Ferreira, Pedro
    Martins, Andre F. T.
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, 2018, : 370 - 376
  • [29] Bilingual attention based neural machine translation
    Kang, Liyan
    He, Shaojie
    Wang, Mingxuan
    Long, Fei
    Su, Jinsong
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4302 - 4315
  • [30] Bilingual attention based neural machine translation
    Liyan Kang
    Shaojie He
    Mingxuan Wang
    Fei Long
    Jinsong Su
    Applied Intelligence, 2023, 53 : 4302 - 4315