Human Evaluation of Online Machine Translation Services for English/Russian-Croatian

被引：7

作者：

Seljan, Sanja ^{[1
]}

Tucakovic, Marko ^{[1
]}

Dunder, Ivan ^{[1
]}

机构：

[1] Univ Zagreb, Fac Humanities & Social Sci, Dept Informat & Commun Sci, Ivana Lucica 3, Zagreb 10000, Croatia

来源：

NEW CONTRIBUTIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, PT 1 | 2015年 / 353卷

关键词：

machine translation; human evaluation; Google Translate; Yandex.Translate; English; Russian; Croatian; adequacy; fluency; error analysis; inter-evaluator agreement;

D O I：

10.1007/978-3-319-16486-1_108

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper presents results of human evaluation of machine translated texts for one non closely-related language pair, English-Croatian, and for one closely-related language pair, Russian-Croatian. 400 sentences from the domain of tourist guides were analysed, i.e. 100 sentences for each language pair and for two online machine translation services, Google Translate and Yandex.Translate. Human evaluation is made with regard to the criteria of fluency and adequacy. In order to measure internal consistency, Cronbach's alpha is calculated. Error analysis is made for several categories: untranslated/omitted words, surplus words, morphological errors/wrong word endings, lexical errors/wrong translations, syntactic errors/wrong word order and punctuation errors. At the end of this paper, conclusions and suggestions for further research are given.

引用

页码：1089 / 1098

页数：10

共 50 条

[31] Translation of German and English Human-Denoting Compound Nouns into Russian
Ivanova, Tatiana
Arzhantseva, Natalia
PROCEEDINGS OF 5TH WORLD CONFERENCE ON LEARNING, TEACHING AND EDUCATIONAL LEADERSHIP, 2015, 186 : 1248 - 1254
[32] MACHINE TRANSLATION OF RUSSIAN ORGANIC CHEMICAL NAMES INTO ENGLISH BY ANALYSIS AND RESYNTHESIS OF THE COMPONENT FRAGMENTS
SUMMERS, L
JOURNAL OF CHEMICAL DOCUMENTATION, 1962, 2 (02): : 83 - 86
[33] Multi-Source Transformer for Kazakh-Russian-English Neural Machine Translation
Littell, Patrick
Lo, Chi-kiu
Larkin, Samuel
Stewart, Darlene
FOURTH CONFERENCE ON MACHINE TRANSLATION (WMT 2019), 2019, : 267 - 274
[34] Translation students' use and evaluation of online resources for Chinese-English translation at the word level
Xu, Mianjun
Wang, Caiwen
TRANSLATION AND INTERPRETING STUDIES, 2011, 6 (01): : 62 - 86
[35] On "Human Parity" and "Super Human Performance" in Machine Translation Evaluation
Poibeau, Thierry
LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2022, : 6018 - 6023
[36] Linguistically Motivated Evaluation of English-Latvian Statistical Machine Translation
Skadina, Inguna
Levane-Petrova, Kristine
Rabante, Guna
HUMAN LANGUAGE TECHNOLOGIES: THE BALTIC PERSPECTIVE, 2012, 247 : 221 - 229
[37] Evaluation of English to Arabic Machine Translation Systems using BLEU and GTM
Al-Rukban, Aljoharah
Saudagar, Abdul Khader Jilani
PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY AND COMPUTERS (ICETC 2017), 2017, : 228 - 232
[38] An English-Chinese Machine Translation and Evaluation Method for Geographical Names
Ren, Hongkai
Mao, Xi
Ma, Weijun
Wang, Jizhou
Wang, Linyun
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (03)
[39] An Improvement in BLEU Metric for English-Hindi Machine Translation Evaluation
Malik, Pooja
Baghel, Anurag Singh
2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2016, : 331 - 336
[40] Online Machine Translation Use With Nursing Literature Evaluation Method and Usability
Anazawa, Ryoko
Ishikawa, Hirono
Park, M. J.
Kiuchi, Takahiro
CIN-COMPUTERS INFORMATICS NURSING, 2013, 31 (02) : 59 - 65

← 1 2 3 4 5 →