Human Evaluation of Online Machine Translation Services for English/Russian-Croatian

被引：7
|
作者：
Seljan, Sanja [1 ]
Tucakovic, Marko [1 ]
Dunder, Ivan [1 ]
机构：
[1] Univ Zagreb, Fac Humanities & Social Sci, Dept Informat & Commun Sci, Ivana Lucica 3, Zagreb 10000, Croatia
来源：
NEW CONTRIBUTIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, PT 1 | 2015年 / 353卷
关键词：
machine translation; human evaluation; Google Translate; Yandex.Translate; English; Russian; Croatian; adequacy; fluency; error analysis; inter-evaluator agreement;
D O I：
10.1007/978-3-319-16486-1_108
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents results of human evaluation of machine translated texts for one non closely-related language pair, English-Croatian, and for one closely-related language pair, Russian-Croatian. 400 sentences from the domain of tourist guides were analysed, i.e. 100 sentences for each language pair and for two online machine translation services, Google Translate and Yandex.Translate. Human evaluation is made with regard to the criteria of fluency and adequacy. In order to measure internal consistency, Cronbach's alpha is calculated. Error analysis is made for several categories: untranslated/omitted words, surplus words, morphological errors/wrong word endings, lexical errors/wrong translations, syntactic errors/wrong word order and punctuation errors. At the end of this paper, conclusions and suggestions for further research are given.
引用
收藏
页码：1089 / 1098
页数：10
相关论文
共 50 条
  • [1] Quantitative fine-grained human evaluation of machine translation systems: a case study on English to Croatian
    Klubicka, Filip
    Toral, Antonio
    Sanchez-Cartagena, Victor M.
    MACHINE TRANSLATION, 2018, 32 (03) : 195 - 215
  • [2] A human evaluation of English-Slovak machine translation
    Munkova, Dasa
    Panisova, Ludmila
    Welnitzova, Katarina
    PERSPECTIVES-STUDIES IN TRANSLATION THEORY AND PRACTICE, 2023, 31 (06): : 1142 - 1161
  • [3] QUALITY AND FORM OF A MACHINE TRANSLATION OF RUSSIAN INTO ENGLISH
    DAHLBERG, I
    NACHRICHTEN FUR DOKUMENTATION, 1974, 25 (02): : 71 - 72
  • [4] Hybrid Machine Translation For English to Marathi: A Research Evaluation In Machine Translation
    Salunkhe, Pramod
    Kadam, Aniket D.
    Joshi, Shashank
    Patil, Shuhas
    Thakore, Devendrasingh
    Jadhav, Shrikant
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 924 - 931
  • [5] Problems of machine translation of business texts from Russian into English
    A. V. Novikova
    L. A. Mylnikov
    Automatic Documentation and Mathematical Linguistics, 2017, 51 (3) : 159 - 169
  • [6] Evaluation of Arabic to English Machine Translation Systems
    Zakraoui, Jezia
    Saleh, Moutaz
    Al-Maadeed, Somaya
    AlJa'am, Jihad Mohamad
    2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2020, : 185 - 190
  • [7] COMPUTER EVALUATION OF MECHANICAL TRANSLATION OF LANGUAGES (RUSSIAN TO ENGLISH)
    JOHNSON, DL
    COMMUNICATIONS OF THE ACM, 1960, 3 (11) : 597 - 597
  • [8] Evaluation of Online Machine Translation by Nursing Users
    Anazawa, Ryoko
    Ishikawa, Hirono
    Takahiro, Kiuchi
    CIN-COMPUTERS INFORMATICS NURSING, 2013, 31 (08) : 382 - 387
  • [9] Translation Mechanism of Neural Machine Algorithm for Online English Resources
    Ye, Yanping
    COMPLEXITY, 2021, 2021
  • [10] Multilingual Chat through Machine Translation: A Case of English-Russian
    Sahin, Mehmet
    Duman, Derya
    META, 2013, 58 (02) : 397 - 410
12345