On the application of different evolutionary algorithms to the alignment problem in statistical machine translation

被引:7
|
作者
Rodriguez, Luis [1 ]
Garcia-Varea, Ismael [1 ]
Gamez, Jose A. [1 ]
机构
[1] Univ Castilla La Mancha, Dept Sistemas Informat SIMD, Albacete 02071, Spain
关键词
evolutionary algorithms; estimation of distribution algorithms; statistical machine translation; statistical alignments;
D O I
10.1016/j.neucom.2007.10.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In statistical machine translation, an alignment defines a mapping between the words in the source and in the target sentence. Alignments are used, on the one hand, to train the statistical models and, on the other, during the decoding process to link the words in the source sentence to the words in the partial hypotheses generated. In both cases, the quality of the alignments is crucial for the success of the translation process. In this paper, we propose several evolutionary algorithms for computing alignments between two sentences in a parallel corpus. This algorithm has been tested on different tasks involving different pair of languages. Specifically, in the two shared tasks proposed in the HLT-NAACL 2003 and in the ACL 2005, the EDA-based algorithm outperforms the best participant systems. In addition, the experiments show that, because of the limitations of the well known statistical alignment models, new improvements in alignments quality could not be achieved by using improved search algorithms only. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 50 条
  • [1] Bilingual chunk alignment in statistical machine translation
    Zhou, Y
    Zong, CQ
    Xu, B
    2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 1401 - 1406
  • [2] Phrase Alignment Confidence for Statistical Machine Translation
    Ananthakrishnan, Sankaranarayanan
    Prasad, Rohit
    Natarajan, Prem
    11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2878 - 2881
  • [3] The alignment template approach to statistical machine translation
    Och, FJ
    Ney, H
    COMPUTATIONAL LINGUISTICS, 2004, 30 (04) : 417 - 449
  • [4] HMM word and phrase alignment for statistical machine translation
    Deng, Yonggang
    Byrne, William
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2008, 16 (03): : 494 - 507
  • [5] Measuring word alignment quality for statistical machine translation
    Fraser, Alexander
    Marcu, Daniel
    COMPUTATIONAL LINGUISTICS, 2007, 33 (03) : 293 - 303
  • [6] Theory of Alignment Generators and Applications to Statistical Machine Translation
    Udupa, Raghavendra U.
    Maji, Hemanta K.
    19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05), 2005, : 1142 - 1147
  • [7] Statistical machine translation using hierarchical phrase alignment
    Watanabe, Taro
    Imamura, Kenji
    Sumita, Eiichiro
    Okuno, Hiroshi G.
    Systems and Computers in Japan, 2007, 38 (06) : 70 - 79
  • [8] EDA: An evolutionary decoding algorithm for statistical machine translation
    Otto, Eridan
    Riff, Maria Cristina
    APPLIED ARTIFICIAL INTELLIGENCE, 2007, 21 (07) : 605 - 621
  • [9] Improved feature decay algorithms for statistical machine translation
    Poncelas, Alberto
    Wenniger, Gideon Maillette de Buy
    Way, Andy
    NATURAL LANGUAGE ENGINEERING, 2022, 28 (01) : 71 - 91
  • [10] Linguistically motivated statistical machine translation: models and algorithms
    Vandeghinste, Vincent
    MACHINE TRANSLATION, 2015, 29 (3-4) : 291 - 294