Shallow Parsing of Chinese Based on HMM Model

被引:0
|
作者
Zheng Weifa [1 ]
Xie Wenliang [1 ]
机构
[1] Guangdong Univ Business Studies, Informat Off, Guangzhou 510320, Peoples R China
关键词
HMM; Shallow Parsing; Natural Language Processing;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Complete parsing is difficult to meet the need of. precision and recall rate in Chinese. To address this problem, a new model for shallow parsing of Chinese is presented in this paper. We adopt Church theory and carry on Chinese phrases recognition based on HMM; improve the precision rate of sentences separation by improving the observance probabilities of HMM model and making use of the context information of the Chinese sentences. At the same time, by studying the rules of Chinese sentence, we extract some rules useful for ambiguity elimination. The experimental result indicates that the model based on HMM has high precision and recall rate.
引用
收藏
页码:79 / 86
页数:8
相关论文
共 50 条
  • [1] Shallow semantic parsing of Chinese
    Sun, H
    Jurafsky, D
    HLT-NAACL 2004: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2004, : 249 - 256
  • [2] Chinese shallow semantic parsing based on multilevel linguistic clues
    Wan, Fucheng
    Yang, Fangtao
    Wu, Tiantian
    Zhang, Dongjiao
    Zhang, Lei
    Wang, Yicheng
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2020, 20 (04) : 1063 - 1072
  • [3] Parsing Chinese based on lexicalized model
    MOE-MS Key Lab. of Natural Language Processing and Speech, Harbin Institute of Technology, Harbin 150001, China
    Dianzi Yu Xinxi Xuebao, 2007, 9 (2082-2085):
  • [4] Creation of topic map with shallow parsing in Chinese
    Yeh, CL
    Chen, YC
    Proceedings of the 2005 IEEE International Conference on Information Reuse and Integration, 2005, : 61 - 65
  • [5] A Sparse Protocol Parsing Method for IIoT Protocols Based on HMM hybrid model
    He, Yunhua
    Shen, Jialong
    Xiao, Ke
    Sood, Keshav
    Wang, Chao
    Sun, Limin
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [6] Chinese Shallow Semantic Parsing Based on Multi-method of Machine Learning
    Wan, Fucheng
    He, Xiangzhen
    Zhang, Dongjiao
    Qi, Guo
    Zhu, Ao
    Lei, Zhang
    Zenan, Ning
    Yicheng, Wang
    JOURNAL OF WEB ENGINEERING, 2020, 19 (5-6): : 685 - 706
  • [7] Chinese Dependency Parsing Based on An Improved Model of MST
    Qi, Sun
    Yang, Xiang
    Xiao, Tu
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS, NETWORK AND COMPUTER ENGINEERING (ICENCE 2016), 2016, 67 : 9 - 14
  • [8] Chinese shallow parsing using different phase systems
    Tan, YM
    Zhong, YX
    Proceedings of the 2005 IEEE International Conference on Natural Language Processing and Knowledge Engineering (IEEE NLP-KE'05), 2005, : 272 - 276
  • [9] Shallow semantic parsing for lexical units in Chinese FrameNet
    Hao Xiaoyan
    Chang Xiaoming
    Liu Kaiying
    2008 FOURTH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING, PROCEEDINGS, 2008, : 867 - +
  • [10] Applying conditional random fields to chinese shallow parsing
    Tan, YM
    Yao, TS
    Chen, Q
    Zhu, JB
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2005, 3406 : 167 - 176