Human Evaluation of Online Machine Translation Services for English/Russian-Croatian

被引：7

作者：

Seljan, Sanja ^{[1
]}

Tucakovic, Marko ^{[1
]}

Dunder, Ivan ^{[1
]}

机构：

[1] Univ Zagreb, Fac Humanities & Social Sci, Dept Informat & Commun Sci, Ivana Lucica 3, Zagreb 10000, Croatia

来源：

NEW CONTRIBUTIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, PT 1 | 2015年 / 353卷

关键词：

machine translation; human evaluation; Google Translate; Yandex.Translate; English; Russian; Croatian; adequacy; fluency; error analysis; inter-evaluator agreement;

D O I：

10.1007/978-3-319-16486-1_108

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper presents results of human evaluation of machine translated texts for one non closely-related language pair, English-Croatian, and for one closely-related language pair, Russian-Croatian. 400 sentences from the domain of tourist guides were analysed, i.e. 100 sentences for each language pair and for two online machine translation services, Google Translate and Yandex.Translate. Human evaluation is made with regard to the criteria of fluency and adequacy. In order to measure internal consistency, Cronbach's alpha is calculated. Error analysis is made for several categories: untranslated/omitted words, surplus words, morphological errors/wrong word endings, lexical errors/wrong translations, syntactic errors/wrong word order and punctuation errors. At the end of this paper, conclusions and suggestions for further research are given.

引用

页码：1089 / 1098

页数：10

共 50 条

[41] An Automatic Evaluation for Online Machine Translation: Holy Quran Case Study
AlSukhni, Emad
Al-Kabi, Mohammed N.
Alsmadi, Izzat M.
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (06) : 118 - 123
[42] Toward More Effective Human Evaluation for Machine Translation
Saldias, Belen
Foster, George
Freitag, Markus
Tan, Qijun
PROCEEDINGS OF THE 2ND WORKSHOP ON HUMAN EVALUATION OF NLP SYSTEMS (HUMEVAL 2022), 2022, : 76 - 89
[43] Human-machine Translation Model Evaluation Based on Artificial Intelligence Translation
Li, Ruicha
Nawi, Abdullah Mohd
Kang, Myoung Sook
EMITTER-INTERNATIONAL JOURNAL OF ENGINEERING TECHNOLOGY, 2023, 11 (02)
[44] Linguistic evaluation of German-English Machine Translation using a Test Suite
Avramidis, Eleftherios
Macketanz, Vivien
Strohriegel, Ursula
Uszkoreit, Hans
FOURTH CONFERENCE ON MACHINE TRANSLATION (WMT 2019), 2019, : 445 - 454
[45] QUANTITATIVE-EVALUATION OF ENGLISH-JAPANESE MACHINE TRANSLATION OF MEDICAL LITERATURE
KIUCHI, T
KAIHARA, S
METHODS OF INFORMATION IN MEDICINE, 1991, 30 (03) : 199 - 205
[46] English-Turkish Literary Translation Through Human-Machine Interaction
Sahin, Mehmet
Gurses, Sabri
TRADUMATICA-TRADUCCIO I TECNOLOGIES DE LA INFORMACIO I LA COMUNICACIO, 2021, (19): : 179 - 203
[47] THE IMPACT OF RESPONDENTS' MULTILINGUALISM ON HUMAN EVALUATION OF MACHINE TRANSLATION QUALITY
Ljubas, Sandra
JEZIKOSLOVLJE, 2020, 21 (02): : 207 - 235
[48] Composing Human and Machine Translation Services: Language Grid for Improving Localization Processes
Lin, Donghui
Murakami, Yoshiaki
Ishida, Toru
Murakami, Yohei
Tanaka, Masahiro
LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010,
[49] The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English
Guzman, Francisco
Chen, Peng-Jen
Ott, Myle
Pino, Juan
Lample, Guillaume
Koehn, Philipp
Chaudhary, Vishrav
Ranzato, Marc'Aurelio
2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6098 - 6111
[50] Statistical analysis of machine translation evaluation systems for English-Hindi language pair
Malik P.
Mrudula Y.
Baghel A.S.
Recent Advances in Computer Science and Communications, 2020, 13 (05) : 864 - 870

← 1 2 3 4 5 →