Controlling Translation Formality Using Pre-trained Multilingual Language Models

被引：0

作者：

Rippeth, Elijah ^{[1
]}

Agrawal, Sweta ^{[1
]}

Carpuat, Marine ^{[1
]}

机构：

[1] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA

来源：

PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE TRANSLATION (IWSLT 2022) | 2022年

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper describes the University of Maryland's submission to the Special Task on Formality Control for Spoken Language Translation at IWSLT, which evaluates translation from English into 6 languages with diverse grammatical formality markers. We investigate to what extent this problem can be addressed with a single multilingual model, simultaneously controlling its output for target language and formality. Results show that this strategy can approach the translation quality and formality control achieved by dedicated translation models. However, the nature of the underlying pre-trained language model and of the finetuning samples greatly impact results.

引用

页码：327 / 340

页数：14

共 50 条

[11] Improving Braille-Chinese translation with jointly trained and pre-trained language models
Huang, Tianyuan
Su, Wei
Liu, Lei
Cai, Chuan
Yu, Hailong
Yuan, Yongna
DISPLAYS, 2024, 82
[12] No Error Left Behind: Multilingual Grammatical Error Correction with Pre-trained Translation Models
Luhtaru, Agnes
Korotkova, Elizaveta
Fishel, Mark
PROCEEDINGS OF THE 18TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 1209 - 1222
[13] Pre-Trained Language Models and Their Applications
Wang, Haifeng
Li, Jiwei
Wu, Hua
Hovy, Eduard
Sun, Yu
ENGINEERING, 2023, 25 : 51 - 65
[14] Neural machine translation of clinical text: an empirical investigation into multilingual pre-trained language models and transfer-learning
Han, Lifeng
Gladkoff, Serge
Erofeev, Gleb
Sorokina, Irina
Galiano, Betty
Nenadic, Goran
FRONTIERS IN DIGITAL HEALTH, 2024, 6
[15] Tackling the multilingual and heterogeneous documents with the pre-trained language identifiers
Kanfoud M.R.
Bouramoul A.
International Journal of Computers and Applications, 2023, 45 (05) : 391 - 402
[16] Attribute Alignment: Controlling Text Generation from Pre-trained Language Models
Yu, Dian
Yu, Zhou
Sagae, Kenji
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 2251 - 2268
[17] Controlling Pre-trained Language Models for Grade-Specific Text Simplification
Agrawal, Sweta
Carpuat, Marine
2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 12807 - 12819
[18] μBERT: Mutation Testing using Pre-Trained Language Models
Degiovanni, Renzo
Papadakis, Mike
2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW 2022), 2022, : 160 - 169
[19] Devulgarization of Polish Texts Using Pre-trained Language Models
Klamra, Cezary
Wojdyga, Grzegorz
Zurowski, Sebastian
Rosalska, Paulina
Kozlowska, Matylda
Ogrodniczuk, Maciej
COMPUTATIONAL SCIENCE, ICCS 2022, PT II, 2022, : 49 - 55
[20] MERGEDISTILL: Merging Pre-trained Language Models using Distillation
Khanuja, Simran
Johnson, Melvin
Talukdar, Partha
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 2874 - 2887

← 1 2 3 4 5 →