Robust Multi-task Learning-based Korean POS Tagging to OvercomeWord Spacing Errors

被引:0
|
作者
Park, Cheoneum [1 ,2 ]
Kim, Juae [3 ,4 ]
机构
[1] SK Telecom, 65 Eulji Ro, Seoul 04539, South Korea
[2] Hyundai Motor Co, 65 Eulji Ro, Seoul 04539, South Korea
[3] Hankuk Univ Foreign Studies, 107 Imun Ro, Seoul 02451, South Korea
[4] Hyundai Motor Co, 107 Imun Ro, Seoul 02451, South Korea
关键词
Morphological analysis; part-of-speech tagging; word spacing; multi-task learning;
D O I
10.1145/3591206
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end neural network-based approaches have recently demonstrated significant improvements in natural language processing (NLP). However, in the NLP application such as assistant systems, NLP components are still processed to extract results using a pipeline paradigm. The pipeline-based concept has issues with error propagation. In Korean, morphological analysis and part-of-speech (POS) tagging step, incorrectly analyzing POS tags for a sentence containing spacing errors negatively affects other modules behind the POS module. Hence, we present a multi-task learning-based POS tagging neural model for Korean with word spacing challenges. When we apply this model to the Korean morphological analysis and POS tagging, we get findings that are robust to word spacing errors. We adopt syllable-level input and output formats, as well as a simple structure for ELECTRA and RNN-CRF models for multi-task learning, and we achieve a good performance 98.30 of F1, better than previous studies on the Sejong corpus test set.
引用
收藏
页数:13
相关论文
共 50 条
  • [11] Robust Temporal Smoothness in Multi-Task Learning
    Zhou, Menghui
    Zhang, Yu
    Yang, Yun
    Liu, Tong
    Yang, Po
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11426 - 11434
  • [12] Hybrid multi-task learning-based response surface modeling in manufacturing
    Yang, Yuhang
    Shao, Chenhui
    JOURNAL OF MANUFACTURING SYSTEMS, 2021, 59 : 607 - 616
  • [13] Multi-Task Learning-Based CSI Feedback Design in Multiple Scenarios
    Li, Xiangyi
    Guo, Jiajia
    Wen, Chao-Kai
    Jin, Shi
    Han, Shuangfeng
    Wang, Xiaoyun
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (12) : 7039 - 7055
  • [14] Multi-task multi-scale attention learning-based facial age estimation
    Shi, Chaojun
    Zhao, Shiwei
    Zhang, Ke
    Feng, Xiaohan
    IET SIGNAL PROCESSING, 2023, 17 (02)
  • [15] Deep Learning-Based Image Geolocation for Travel Recommendation via Multi-Task Learning
    Gu, Fangfang
    Jiang, Keshen
    Hu, Xiaoyi
    Yang, Jie
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2022, 31 (07)
  • [16] ROM: A Robust Online Multi-Task Learning Approach
    Zhang, Chi
    Zhao, Peilin
    Hao, Shuji
    Soh, Yeng Chai
    Lee, Bu Sung
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 1341 - 1346
  • [17] Robust Multi-Task Learning With Flexible Manifold Constraint
    Zhang, Rui
    Zhang, Hongyuan
    Li, Xuelong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (06) : 2150 - 2157
  • [18] Multi-Task Learning-Based Task Scheduling Switcher for a Resource-Constrained IoT System
    Bin Kamilin, Mohd Hafizuddin
    Bin Ahmadon, Mohd Anuaruddin
    Yamaguchi, Shingo
    INFORMATION, 2021, 12 (04)
  • [19] A multi-task learning-based framework for global maritime and destination with AIS data
    Wang, Wells
    Bin, Junchi
    Zaji, Amirhossein
    Halldearn, Richard
    Guillaume, Fabien
    Li, Eric
    Liu, Zheng
    MARITIME TRANSPORT RESEARCH, 2022, 3
  • [20] Deep Multi-Task Learning-Based Simultaneous Channel Tap and Coefficient Estimation
    Aygul, Mehmet Ali
    Cirpan, Hakan Ali
    Arslan, Huseyin
    2023 IEEE FUTURE NETWORKS WORLD FORUM, FNWF, 2024,