A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

被引:6
|
作者
Zhang Yangsen [1 ]
Li Jianlong [1 ]
Xin Yonghui [2 ]
Zhao Xiquan [1 ]
Liu Yang [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Inst Intelligent Informat Proc, Beijing 100192, Peoples R China
[2] Coordinat Ctr China, Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition (NER); Global pointer; RoBERTa-WWM model; Fast gradient method (FGM); BiGRU;
D O I
10.23919/cje.2022.00.279
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To solve the problem that the Chinese named entity recognition (NER) models have poor anti-interference ability and inaccurate entity boundary recognition, this paper proposes the RGP-with-FGM model which is based on global pointer and adversarial learning. Firstly, the RoBERTa-WWM model is used to optimize the semantic representation of the text, and fast gradient method is used to add perturbation to the word embedding layer to enhance the robustness of the model. Then, BiGRU is used to focus on the timing information of Chinese characters to enhance the semantic connection. Finally, the global pointer is constructed in the decoding layer to obtain more accurate entity boundary recognition results. In order to verify the effectiveness of the model proposed in this paper, we construct Uyghur names dataset (UHND) to train the Chinese NER model, and perform extensive experiments with public Chinese NER data sets. Experimental results show that for UHND, the F1 value is 95.12%, which is 3.09% higher than that of the RoBERTa-WWM-BiGRU-CRF model. For the Resume data set, the Precision and F1 value are 96.28% and 96.10% respectively.
引用
收藏
页码:854 / 867
页数:14
相关论文
共 50 条
  • [31] A Hybrid Model Based on CRFs for Chinese Named Entity Recognition
    Li, Lishuang
    Ding, Zhuoye
    Huang, Degen
    Zhou, Huiwei
    ALPIT 2008: SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED LANGUAGE PROCESSING AND WEB INFORMATION TECHNOLOGY, PROCEEDINGS, 2008, : 127 - 132
  • [32] Chinese Named Entity Recognition Based on Hierarchical Hybrid Model
    Liao, Zhihua
    Zhang, Zili
    Liu, Yang
    PRICAI 2010: TRENDS IN ARTIFICIAL INTELLIGENCE, 2010, 6230 : 620 - +
  • [33] Chinese Named Entity Recognition for IC Patent Domain Based on RoBERTa-wwm-ext, GCN and Efficient Global Pointer
    Lin, Yunxiao
    Tang, Jiahao
    Huang, Wenjun
    Ding, Yanyu
    Hu, Jianguo
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKS AND INTERNET OF THINGS, CNIOT 2024, 2024, : 234 - 240
  • [34] A hybrid model for Chinese named entity recognition
    Sun, Xiao
    Huang, Degen
    RECENT ADVANCE OF CHINESE COMPUTING TECHNOLOGIES, 2007, : 232 - 237
  • [35] A Research Toward Chinese Named Entity Recognition Based on Transfer Learning
    Hui Kang
    Jingwu Xiao
    Yunpeng Zhang
    Lei Zhang
    Xu Zhao
    Tie Feng
    International Journal of Computational Intelligence Systems, 16
  • [36] CRF-based Active Learning for Chinese Named Entity Recognition
    Yao, Lin
    Sun, Chengjie
    Li, Shaofeng
    Wang, Xiaolong
    Wang, Xuan
    2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 1557 - +
  • [37] A Research Toward Chinese Named Entity Recognition Based on Transfer Learning
    Kang, Hui
    Xiao, Jingwu
    Zhang, Yunpeng
    Zhang, Lei
    Zhao, Xu
    Feng, Tie
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [38] Adversarial Transfer for Named Entity Boundary Detection with Pointer Networks
    Li, Jing
    Ye, Deheng
    Shang, Shuo
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5053 - 5059
  • [39] Survey on Chinese named entity recognition with deep learning
    Kang Y.
    Sun L.
    Zhu R.
    Li M.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2022, 50 (11): : 44 - 53
  • [40] An ERNIE-Based Joint Model for Chinese Named Entity Recognition
    Wang, Yu
    Sun, Yining
    Ma, Zuchang
    Gao, Lisheng
    Xu, Yang
    APPLIED SCIENCES-BASEL, 2020, 10 (16):