Research of English-Chinese alignment at word granularity on parallel corpora

被引:0
|
作者
Xu Yang [1 ]
Wang Hou-feng [1 ]
Lue Xue-qiang [2 ]
机构
[1] Peking Univ, Beijing 100871, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Beijing 100101, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICIS.2008.28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Bilingual alignment is a crucial problem in the research of natural language processing, and word alignment is a nodus among all granularities of alignment. This paper describes an English-Chinese word alignment model based on a bilingual lexicon and some language knowledge, which works on bilingual corpora. The model is built on the theory of formal optimal partition of the bilingual sentence pairs, and is ubiquitous to sentences pairs of any natural language. Particularly, we obtain some alignment strategies which are independent to alignment direction by denoting some definitions and proving a theorem. The model deals with part-matching cases, solves multi-appear-word problems and remedies the deficiency of bilingual lexicon. The experimental results show that the model can align bilingual corpora at word level effectively with a high accuracy, and maintain the grammar structure of the original sentences at the same time.
引用
收藏
页码:223 / +
页数:2
相关论文
共 50 条