On the application of different evolutionary algorithms to the alignment problem in statistical machine translation

被引:7
|
作者
Rodriguez, Luis [1 ]
Garcia-Varea, Ismael [1 ]
Gamez, Jose A. [1 ]
机构
[1] Univ Castilla La Mancha, Dept Sistemas Informat SIMD, Albacete 02071, Spain
关键词
evolutionary algorithms; estimation of distribution algorithms; statistical machine translation; statistical alignments;
D O I
10.1016/j.neucom.2007.10.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In statistical machine translation, an alignment defines a mapping between the words in the source and in the target sentence. Alignments are used, on the one hand, to train the statistical models and, on the other, during the decoding process to link the words in the source sentence to the words in the partial hypotheses generated. In both cases, the quality of the alignments is crucial for the success of the translation process. In this paper, we propose several evolutionary algorithms for computing alignments between two sentences in a parallel corpus. This algorithm has been tested on different tasks involving different pair of languages. Specifically, in the two shared tasks proposed in the HLT-NAACL 2003 and in the ACL 2005, the EDA-based algorithm outperforms the best participant systems. In addition, the experiments show that, because of the limitations of the well known statistical alignment models, new improvements in alignments quality could not be achieved by using improved search algorithms only. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:755 / 765
页数:11
相关论文
共 50 条
  • [41] Statistical Machine Translation
    Zhang Xiaojun
    APPLIED LINGUISTICS, 2011, 32 (03) : 359 - 362
  • [42] Neural Machine Translation Advised by Statistical Machine Translation
    Wang, Xing
    Lu, Zhengdong
    Tu, Zhaopeng
    Li, Hang
    Xiong, Deyi
    Zhang, Min
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3330 - 3336
  • [43] The application of predictive scheduling algorithms for single machine problem
    Zhang Ying
    Chao Zhijun
    Xi Yugeng
    PROCEEDINGS OF THE 26TH CHINESE CONTROL CONFERENCE, VOL 4, 2007, : 810 - +
  • [44] An empirical comparison of stack-based decoding algorithms for statistical machine translation
    Ortiz, D
    Varea, IG
    Casacuberta, F
    PATTERN RECOGNITION AND IMAGE ANALYSIS, PROCEEDINGS, 2003, 2652 : 654 - 663
  • [45] A weighted finite state transducer implementation of the alignment template model for statistical machine translation
    Kumar, S
    Byrne, W
    HLT-NAACL 2003: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2003, : 142 - 149
  • [46] Refining Kazakh Word Alignment Using Simulation Modeling Methods for Statistical Machine Translation
    Kartbayev, Amandyk
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2015, 2015, 9362 : 421 - 427
  • [47] Hybrid Neural Network Alignment and Lexicon Model in Direct HMM for Statistical Machine Translation
    Wang, Weiyue
    Alkhouli, Tamer
    Zhu, Derui
    Ney, Hermann
    PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 2, 2017, : 125 - 131
  • [48] Comparing and integrating alignment template and standard phrase-based statistical machine translation
    Xu, Lin
    Cao, Xiaoguang
    Zhang, Bufeng
    Li, Mu
    Computational Linguistics and Intelligent Text Processing, 2007, 4394 : 420 - 431
  • [49] Application of Evolutionary Algorithms and Statistical Analysis in the Numerical Optimization of an Axial Compressor
    Clarich, Alberto
    Mosetti, Giovanni
    Pediroda, Valentino
    Poloni, Carlo
    INTERNATIONAL JOURNAL OF ROTATING MACHINERY, 2005, 2005 (02) : 143 - 151
  • [50] The application of evolutionary algorithms in the search of relevant statistical features of infrared images
    Fidali, Marek
    Urbanek, Grzegorz
    QUANTITATIVE INFRARED THERMOGRAPHY JOURNAL, 2012, 9 (01) : 33 - 54