Semi-supervised maximum entropy based POS tagging for large scale Chinese corpus

被引：0
|
作者：
Yuan, Caixia [1 ]
Wang, Xiaojie [1 ]
Zhai, Junjie [1 ]
机构：
[1] Beijing Univ Posts & Telecommun, Sch Informat Engn, Beijing 100876, Peoples R China
来源：
PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE: 50 YEARS' ACHIEVEMENTS, FUTURE DIRECTIONS AND SOCIAL IMPACTS | 2006年
关键词：
semi-supervised; maximum entropy; Chinese POS tagging;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper presents issues related to POS tagging for large-scale Chinese corpus using the maximum entropy technique, in which unlabeled data are introduced for compensating the sparseness and inconsistency of labeled data. We test our method on the corpus of Peking University China and show that as much as 27% error reduction is obtained by semi-supervised strategy.
引用
收藏
页码：385 / 389
页数：5
相关论文
共 50 条
  • [1] Chinese POS tagging based on maximum entropy model
    Zhao, R
    Wang, XL
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 601 - 605
  • [2] Simple semi-supervised learning for chinese word segmentation and pos tagging
    Li, Xinxin
    Wang, Xuan
    Waqas, Muhammad
    Harbin, Anwar
    Information Technology Journal, 2013, 12 (20) : 5955 - 5961
  • [3] Graph Based Semi-Supervised Learning for Tamil POS Tagging
    Thayaparan, Mokanarangan
    Ranathunga, Surangika
    Thayasivam, Uthayasanker
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 3955 - 3960
  • [4] Some improvements on maximum entropy based Chinese POS tagging
    Center for Intelligence Science and Technology Research, Beijing University of Posts and Telecommunications, Beijing 100876, China
    J. China Univ. Post Telecom., 2006, SUPPL. (99-103):
  • [5] A semi-supervised associative classification method for POS tagging
    Rani P.
    Pudi V.
    Sharma D.M.
    International Journal of Data Science and Analytics, 2016, 1 (2) : 123 - 136
  • [6] Applying class triggers in Chinese pos tagging based on maximum entropy model
    Zhao, Y
    Wang, XL
    Liu, BQ
    Guan, Y
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 1641 - 1645
  • [7] Chinese POS tagging employing maximum entropy and word clustering
    Ma, Jianjun
    Huang, Degen
    Li, Zezhong
    Journal of Information and Computational Science, 2010, 7 (12): : 2420 - 2428
  • [8] Chinese POS Tagging Using Restricted Maximum Entropy Model
    Zhang Hong
    Ren Fuji
    CHINESE JOURNAL OF ELECTRONICS, 2010, 19 (01): : 39 - 42
  • [9] An English POS Tagging Approach Based on Maximum Entropy
    Yi, Chen
    2015 INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION, BIG DATA AND SMART CITY (ICITBS), 2016, : 81 - 84
  • [10] Maximum Entropy Semi-Supervised Inverse Reinforcement Learning
    Audiffren, Julien
    Valko, Michal
    Lazaric, Alessandro
    Ghavamzadeh, Mohammad
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 3315 - 3321
12345