Named Entity Correction in Neural Machine Translation Using the Attention Alignment Map

被引:4
|
作者
Lee, Jangwon [1 ,2 ]
Lee, Jungi [3 ]
Lee, Minho [3 ]
Jang, Gil-Jin [2 ,4 ]
机构
[1] SK Holdings C&C, Suwon 13558, South Korea
[2] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu 41566, South Korea
[3] Kyungpook Natl Univ, Dept Artificial Intelligence, Daegu 41566, South Korea
[4] Kyungpook Natl Univ, Sch Elect Engn, Daegu 41566, South Korea
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 15期
基金
新加坡国家研究基金会;
关键词
neural networks; recurrent neural networks; natural language processing; neural machine translation; named entity recognition; SEQUENCE;
D O I
10.3390/app11157026
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application machine translation; information retrieval; text-to-speech. Neural machine translation (NMT) methods based on various artificial neural network models have shown remarkable performance in diverse tasks and have become mainstream for machine translation currently. Despite the recent successes of NMT applications, a predefined vocabulary is still required, meaning that it cannot cope with out-of-vocabulary (OOV) or rarely occurring words. In this paper, we propose a postprocessing method for correcting machine translation outputs using a named entity recognition (NER) model to overcome the problem of OOV words in NMT tasks. We use attention alignment mapping (AAM) between the named entities of input and output sentences, and mistranslated named entities are corrected using word look-up tables. The proposed method corrects named entities only, so it does not require retraining of existing NMT models. We carried out translation experiments on a Chinese-to-Korean translation task for Korean historical documents, and the evaluation results demonstrated that the proposed method improved the bilingual evaluation understudy (BLEU) score by 3.70 from the baseline.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] The Impact of Named Entity Translation for Neural Machine Translation
    Yan, Jinghui
    Zhang, Jiajun
    Xu, JinAn
    Zong, Chengqing
    MACHINE TRANSLATION, CWMT 2018, 2019, 954 : 63 - 73
  • [2] Neural machine translation incorporating named entity
    Ugawa, Arata
    Tamura, Akihiro
    Ninomiya, Takashi
    Takamura, Hiroya
    Okumura, Manabu
    COLING 2018 - 27th International Conference on Computational Linguistics, Proceedings, 2018, : 3240 - 3250
  • [3] Neural Machine Translation Techniques for Named Entity Transliteration
    Grundkiewicz, Roman
    Heafield, Kenneth
    NAMED ENTITIES, 2018, : 89 - 94
  • [4] Improving Norwegian Translation of Bicycle Terminology Using Custom Named-Entity Recognition and Neural Machine Translation
    Hellebust, Daniel
    Lawal, Isah A.
    ELECTRONICS, 2023, 12 (10)
  • [5] Named entity translation method based on machine translation lexicon
    Li, Panpan
    Wang, Mengxiang
    Wang, Jian
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (09): : 3977 - 3985
  • [6] Named entity translation method based on machine translation lexicon
    Panpan Li
    Mengxiang Wang
    Jian Wang
    Neural Computing and Applications, 2021, 33 : 3977 - 3985
  • [7] Korean-English named entity alignment for machine translation of digital TV closed caption
    Yuh, S
    Seo, J
    8TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS 1-3: TOWARD THE ERA OF UBIQUITOUS NETWORKS AND SOCIETIES, 2006, : U1717 - U1722
  • [8] Neural Named Entity Recognition Using a Self-Attention Mechanism
    Zukov-Gregoric, Andrej
    Bachrach, Yoram
    Minkovsky, Pasha
    Coope, Sam
    Maksak, Bogdan
    2017 IEEE 29TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2017), 2017, : 652 - 656
  • [9] History Attention for Source-Target Alignment in Neural Machine Translation
    Huang, Yan
    Chao, Wenhan
    Zhang, Peidong
    Yu, Yuanyuan
    PROCEEDINGS OF 2018 TENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2018, : 619 - 624
  • [10] Enhancing Neural Machine Translation of Indigenous Languages through Gender Debiasing and Named Entity Recognition
    Le, Ngoc Tan
    Sadat, Fatiha
    2024 16TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTION, HSI 2024, 2024,