Word sense disambiguation based on maximum entropy classifier

被引:0
|
作者
Zhang C. [1 ]
Zhou X. [2 ]
Gao X. [2 ]
Yu B. [1 ]
机构
[1] School of Software and Microelectronics, Harbin University of Science and Technology, Harbin
[2] School of Computer Science and Technology, Harbin University of Science and Technology, Harbin
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Discriminative features; Maximum entropy classifier; Natural language processing; Semantic category; Word sense disambiguation;
D O I
10.23940/ijpe.19.05.p26.14911498
中图分类号
学科分类号
摘要
Word sense disambiguation (WSD) is one of the most important research issues in the field of natural language processing. In this paper, a new method of word sense disambiguation is proposed, in which words and parts of speech (POS) are extracted as discriminative features. At the same time, a maximum entropy classifier is adopted to determine ambiguous words' semantic categories. Training data of SemEval-2007: Task#5 is used to optimize the maximum entropy model. A test corpus is applied to test the performance of the WSD classifier. Experimental results show that the performance of word sense disambiguation is improved after the proposed approach is used. © 2019 Totem Publisher, Inc. All rights reserved.
引用
收藏
页码:1491 / 1498
页数:7
相关论文
共 50 条
  • [1] Chinese word sense disambiguation based on maximum entropy model with feature selection
    He J.-Z.
    Wang H.-F.
    Ruan Jian Xue Bao/Journal of Software, 2010, 21 (06): : 1287 - 1295
  • [2] Best feature selection for maximum entropy-based word sense disambiguation
    Suárez, A
    Palomar, M
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS, 2002, 2553 : 213 - 217
  • [3] An Empirical Study of Classifier Combination Based Word Sense Disambiguation
    Lu, Wenpeng
    Wu, Hao
    Jian, Ping
    Huang, Yonggang
    Huang, Heyan
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (01): : 225 - 233
  • [4] Word sense disambiguation based on multi-classifier decision
    Department of Computer Science and Technology, Central China Normal University, Wuhan 430079, China
    不详
    Jisuanji Yanjiu yu Fazhan, 2006, 5 (933-939):
  • [5] fastSense: An Efficient Word Sense Disambiguation Classifier
    Uslu, Tolga
    Mehler, Alexander
    Baumartz, Daniel
    Hemati, Wahed
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 1042 - 1046
  • [6] Optimizing Classifier Performance in Word Sense Disambiguation by Redefining Word Sense Classes
    Kohomban, Upali S.
    Lee, Wee Sun
    20TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2007, : 1635 - 1640
  • [7] Word sense disambiguation based on Bayesian classifier with tailored context window
    Wu, Chongbin
    Zhang, Quan
    Journal of Computational Information Systems, 2012, 8 (12): : 5195 - 5202
  • [8] Modeling consensus: Classifier combination for word sense disambiguation
    Florian, R
    Yarowsky, D
    PROCEEDINGS OF THE 2002 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, 2002, : 25 - 32
  • [9] Word sense disambiguation based on word sense clustering
    Anaya-Sanchez, Henry
    Pons-Porrata, Aurora
    Berlanga-Llavori, Rafael
    ADVANCES IN ARTIFICIAL INTELLIGENCE - IBERAMIA-SBIA 2006, PROCEEDINGS, 2006, 4140 : 472 - 481
  • [10] Malayalam Word Sense Disambiguation using Naive Bayes Classifier
    Gopal, Sreelakshmi
    Haroon, Rosna P.
    2016 INTERNATIONAL CONFERENCE ON ADVANCES IN HUMAN MACHINE INTERACTION (HMI), 2016, : 83 - 86