A Data Augmentation Method for English-Vietnamese Neural Machine Translation

被引:4
|
作者
Pham, Nghia Luan [1 ]
Nguyen, Van Vinh [2 ]
Pham, Thang Viet [3 ]
机构
[1] Hai Phong Univ, Lib & Informat Ctr, Haiphong, Vietnam
[2] Vietnam Natl Univ, Univ Engn & Technol, Fac Informat Technol, Hanoi, Vietnam
[3] VU, Univ Med Ctr, Amsterdam, Netherlands
关键词
Machine translation; Data models; Internet; Grammar; Decoding; Symbols; Error correction; Data augmentation; Error analysis; back-translation; machine translation; Vietnamese grammatical error correction;
D O I
10.1109/ACCESS.2023.3252898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The translation quality of machine translation systems depends on the parallel corpus used for training, particularly on the quantity and quality of the corpus. However, building a high-quality and large-scale parallel corpus is complex and expensive, particularly for a specific domain-parallel corpus. Therefore, data augmentation techniques are widely used in machine translation. The input of the back-translation method is monolingual text, which is available from many sources, and therefore, this method can be easily and effectively implemented to generate synthetic parallel data. In practice, monolingual texts can be collected from different sources, in which sources from websites often contain errors in grammar and spelling, sentence mismatch, or freestyle. Therefore, the quality of the output translation is reduced, leading to a low-quality parallel corpus generated by back-translation. In this study, we proposed a method for improving the quality of monolingual texts for back-translation. Moreover, we supplemented the data by pruning the translation table. We experimented with an English-Vietnamese neural machine translation using the IWSLT2015 dataset for training and testing in the legal domain. The results showed that the proposed method can effectively augment parallel data for machine translation, thereby improving translation quality. In our experimental cases, the BLEU score increased by 16.37 points compared with the baseline system.
引用
收藏
页码:28034 / 28044
页数:11
相关论文
共 50 条
  • [41] A Mongolian-Chinese Neural Machine Translation Method Based on Semantic-Context Data Augmentation
    Zhang, Huinuan
    Ji, Yatu
    Wu, Nier
    Lu, Min
    APPLIED SCIENCES-BASEL, 2024, 14 (08):
  • [42] Building a Named Entity Annotated Bilingual English-Vietnamese Corpus
    Tuan-An Dao
    Hung-Thinh Truong
    Long Nguyen
    Dien Dinh
    PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE), 2018, : 61 - 66
  • [43] Corpus Augmentation for Improving Neural Machine Translation
    Li, Zijian
    Chi, Chengying
    Zhan, Yunyun
    CMC-COMPUTERS MATERIALS & CONTINUA, 2020, 64 (01): : 637 - 650
  • [44] Manifold Adversarial Augmentation for Neural Machine Translation
    Chen, Guandan
    Fan, Kai
    Zhang, Kaibo
    Chen, Boxing
    Huang, Zhongqiang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 3184 - 3189
  • [45] An Enhanced Method for Neural Machine Translation via Data Augmentation Based on the Self-Constructed English-Chinese Corpus, WCC-EC
    Zhang, Jinyi
    Guo, Cong
    Mao, Jiannan
    Guo, Chong
    Matsumoto, Tadahiro
    IEEE ACCESS, 2023, 11 : 112123 - 112132
  • [46] Neural machine translation of Hindi and English
    Bhatnagar, Sahil
    Chatterjee, Niladri
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (02) : 2071 - 2079
  • [47] Neural machine translation for Tamil to English
    Jain, Minni
    Punia, Ravneet
    Hooda, Ishika
    JOURNAL OF STATISTICS AND MANAGEMENT SYSTEMS, 2020, 23 (07) : 1251 - 1264
  • [48] Neural Machine Translation for English to Hindi
    Saini, Sandeep
    Sahula, Vineet
    2018 FOURTH INTERNATIONAL CONFERENCE ON INFORMATION RETRIEVAL AND KNOWLEDGE MANAGEMENT (CAMP), 2018, : 25 - 30
  • [49] English to Sinhala Neural Machine Translation
    Fonseka, Thilakshi
    Naranpanawa, Rashmini
    Perera, Ravinga
    Thayasivam, Uthayasanker
    2020 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2020), 2020, : 305 - 309
  • [50] Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation
    Chen, Guanhua
    Chen, Yun
    Wang, Yong
    Li, Victor O. K.
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3587 - 3593