Hybrid approach for Khmer unknown word POS guessing

被引:0
|
作者
Nou, Chenda [1 ]
Kameyama, Wataru [1 ]
机构
[1] Waseda Univ, Grad Sch Global Informat & Telecommun Studies, 1011 Nishi Tomida, Honjo, Saitama 3670035, Japan
关键词
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
New words are being created everyday and the lexicon is not large enough to cover all the words, unknown words become a serious problem in part-of-speech tagging. This paper presents a hybrid approach to handle the unknown word problem in Khmer part-of-speech tagging. The hybrid approach combined of rule-based model and trigram model makes use of both internal structure of the word and surrounding contextual information to predict the part-of-speech of unknown words. The proposed approach achieves 88.9% and 78.2% of accuracy on training and test data respectively.
引用
收藏
页码:215 / +
页数:2
相关论文
共 50 条
  • [21] TEST OF SOPHISTICATED GUESSING THEORY OF WORD PERCEPTION
    JOHNSTON, JC
    COGNITIVE PSYCHOLOGY, 1978, 10 (02) : 123 - 153
  • [22] Multi-Agent Word Guessing Game
    Luis, Gabino
    de la Pena, Jaime
    Suarez, David
    Mateos, Alfonso J.
    ADCAIJ-ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL, 2018, 7 (04): : 17 - 26
  • [23] An Approach for Unknown Word Processing based on Japanese Phonological Rules
    Baba, Tokiya
    Kusu, Kazuma
    Hatano, Kenji
    IIWAS2018: THE 20TH INTERNATIONAL CONFERENCE ON INFORMATION INTEGRATION AND WEB-BASED APPLICATIONS & SERVICES, 2014, : 350 - 354
  • [24] A Simple Approach to Unknown Word Processing in Japanese Morphological Analysis
    Sasano, Ryohei
    Kurohashi, Sadao
    Okumura, Manabu
    6th International Joint Conference on Natural Language Processing, IJCNLP 2013 - Proceedings of the Main Conference, 2013, : 162 - 170
  • [25] PERFORMANCE AND GUESSING ABILITY IN KNOWN AND UNKNOWN TEST DOMAINS
    WINTHROP, H
    PSYCHOLOGICAL REPORTS, 1958, 4 (02) : 341 - 341
  • [26] A Hybrid Approach to Word Segmentation of Vietnamese Texts
    Phuong, Le Hong
    Nguyen Thi Minh Huyen
    Roussanaly, Azim
    Ho Tuong Vinh
    LANGUAGE AND AUTOMATA THEORY AND APPLICATIONS, 2008, 5196 : 240 - +
  • [27] A Hybrid Approach to Analyze the Morphology of an Assamese Word
    Rahman, Mirzanur
    Sarma, Shikhar Kumar
    RECENT DEVELOPMENTS IN MACHINE LEARNING AND DATA ANALYTICS, 2019, 740 : 201 - 209
  • [28] Chinese Word POS Tagging with Markov Logic
    Liao, Zhihua
    Zeng, Qixian
    Wang, Qiyun
    INTELLIGENCE AND SECURITY INFORMATICS, PAISI 2015, 2015, 9074 : 91 - 101
  • [29] A Study on the Practice of Guessing A Word Meanings from a Context
    Seibert, Louise C.
    MODERN LANGUAGE JOURNAL, 1945, 29 (04): : 296 - 322
  • [30] Tabouid: a Wikipedia-based word guessing game
    Bernard, Timothee
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020): SYSTEM DEMONSTRATIONS, 2020, : 24 - 29