Shallow Parsing of Chinese Based on HMM Model

被引:0
|
作者
Zheng Weifa [1 ]
Xie Wenliang [1 ]
机构
[1] Guangdong Univ Business Studies, Informat Off, Guangzhou 510320, Peoples R China
关键词
HMM; Shallow Parsing; Natural Language Processing;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Complete parsing is difficult to meet the need of. precision and recall rate in Chinese. To address this problem, a new model for shallow parsing of Chinese is presented in this paper. We adopt Church theory and carry on Chinese phrases recognition based on HMM; improve the precision rate of sentences separation by improving the observance probabilities of HMM model and making use of the context information of the Chinese sentences. At the same time, by studying the rules of Chinese sentence, we extract some rules useful for ambiguity elimination. The experimental result indicates that the model based on HMM has high precision and recall rate.
引用
收藏
页码:79 / 86
页数:8
相关论文
共 50 条
  • [31] A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing
    Chen, Miaohong
    Chang, Baobao
    Liu, Yang
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA (CCL 2015), 2015, 9427 : 240 - 249
  • [32] A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing
    Yan, Hang
    Qiu, Xipeng
    Huang, Xuanjing
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2020, 8 : 78 - 92
  • [33] Chinese new word finding using character-based parsing model
    Meng, Y
    Yu, H
    Nishino, F
    NATURAL LANGUAGE PROCESSING - IJCNLP 2004, 2005, 3248 : 733 - 742
  • [34] A Shallow Parsing Model for Hindi Using Conditional Random Field
    Asopa, Sneha
    Asopa, Pooja
    Mathur, Iti
    Joshi, Nisheeth
    INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING AND COMMUNICATIONS, VOL 2, 2019, 56 : 295 - 302
  • [35] Zero Pronoun Resolution in Chinese Using Machine Learning plus Shallow Parsing
    Yang, Weijie
    Dai, Ruwei
    Cui, Xia
    2008 INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, VOLS 1-4, 2008, : 905 - 910
  • [36] Transductive HMM based Chinese text chunking
    Li, H
    Webster, JJ
    Kit, CY
    Yao, TS
    2003 INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING, PROCEEDINGS, 2003, : 257 - 262
  • [37] Research on DOP-based Chinese parsing
    Zhang, YJ
    Zhang, T
    Zhu, JB
    Yao, TS
    Proceedings of 2005 International Conference on Machine Learning and Cybernetics, Vols 1-9, 2005, : 3840 - 3845
  • [38] Parsing Chinese text based on semantic class
    Ding, Hua-Fu
    Zhao, Tie-Jun
    Li, Sheng
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 3377 - 3380
  • [39] PARSING CHINESE QUESTIONS BASED ON CONCEPTUAL NETWORK
    He, Ren
    Jun-Fang, Zeng
    Yi-Ping, Yang
    PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, VOLS 1 AND 2, 2006, : 935 - 938
  • [40] Dependency graph based Chinese semantic parsing
    Ding, Y. (dingyu008@gmail.com), 1600, Springer Verlag (8801):