On the application of different evolutionary algorithms to the alignment problem in statistical machine translation

被引:7
|
作者
Rodriguez, Luis [1 ]
Garcia-Varea, Ismael [1 ]
Gamez, Jose A. [1 ]
机构
[1] Univ Castilla La Mancha, Dept Sistemas Informat SIMD, Albacete 02071, Spain
关键词
evolutionary algorithms; estimation of distribution algorithms; statistical machine translation; statistical alignments;
D O I
10.1016/j.neucom.2007.10.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In statistical machine translation, an alignment defines a mapping between the words in the source and in the target sentence. Alignments are used, on the one hand, to train the statistical models and, on the other, during the decoding process to link the words in the source sentence to the words in the partial hypotheses generated. In both cases, the quality of the alignments is crucial for the success of the translation process. In this paper, we propose several evolutionary algorithms for computing alignments between two sentences in a parallel corpus. This algorithm has been tested on different tasks involving different pair of languages. Specifically, in the two shared tasks proposed in the HLT-NAACL 2003 and in the ACL 2005, the EDA-based algorithm outperforms the best participant systems. In addition, the experiments show that, because of the limitations of the well known statistical alignment models, new improvements in alignments quality could not be achieved by using improved search algorithms only. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 50 条
  • [21] English to Tamil Statistical Machine Translation and Alignment Using HMM
    Vetrivel, S.
    Baby, Diana
    RECENT ADVANCES IN NETWORKING, VLSI AND SIGNAL PROCESSING, 2010, : 182 - +
  • [22] Towards an efficient evolutionary decoding algorithm for statistical machine translation
    Otto, E
    Riff, MC
    MICAI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2004, 2972 : 438 - 447
  • [23] On the application of evolutionary algorithms to the consensus tree problem
    Cotta, C
    EVOLUTIONARY COMPUTATION IN COMBINATORIAL OPTIMIZATION, PROCEEDINGS, 2005, 3448 : 58 - 67
  • [24] Domain adaptation problem in statistical machine translation systems
    Chinea-Rios, Mara
    Sanchis-Trilles, German
    Casacuberta, Francisco
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2015, 277 : 205 - 213
  • [25] SyMGiza++: Symmetrized Word Alignment Models for Statistical Machine Translation
    Junczys-Dowmunt, Marcin
    Szal, Arkadiusz
    SECURITY AND INTELLIGENT INFORMATION SYSTEMS, 2012, 7053 : 379 - 390
  • [26] Bayesian Word Alignment and Phrase Table Training for Statistical Machine Translation
    Li, Zezhong
    Ikeda, Hideto
    Fukumoto, Junichi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2013, E96D (07) : 1536 - 1543
  • [28] The Importance of Diversity in the Application of Evolutionary Algorithms to the Sudoku Problem
    Segura, Carlos
    Valdez Pena, S. Ivvan
    Botellu Rionda, Salvador
    Hernandez Aguirre, Arturo
    2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 919 - 926
  • [29] Optimizing Instance Selection for Statistical Machine Translation with Feature Decay Algorithms
    Bicici, Ergun
    Yuret, Deniz
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (02) : 339 - 350
  • [30] Discriminative Spoken Language Understanding Using Statistical Machine Translation Alignment Models
    Aliannejadi, Mohammad
    Khadivi, Shahram
    Ghidary, Saeed Shiry
    Bokaei, Mohammad Hadi
    ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING, AISP 2013, 2014, 427 : 194 - +