A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

被引:6
|
作者
Zhang Yangsen [1 ]
Li Jianlong [1 ]
Xin Yonghui [2 ]
Zhao Xiquan [1 ]
Liu Yang [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Inst Intelligent Informat Proc, Beijing 100192, Peoples R China
[2] Coordinat Ctr China, Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition (NER); Global pointer; RoBERTa-WWM model; Fast gradient method (FGM); BiGRU;
D O I
10.23919/cje.2022.00.279
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To solve the problem that the Chinese named entity recognition (NER) models have poor anti-interference ability and inaccurate entity boundary recognition, this paper proposes the RGP-with-FGM model which is based on global pointer and adversarial learning. Firstly, the RoBERTa-WWM model is used to optimize the semantic representation of the text, and fast gradient method is used to add perturbation to the word embedding layer to enhance the robustness of the model. Then, BiGRU is used to focus on the timing information of Chinese characters to enhance the semantic connection. Finally, the global pointer is constructed in the decoding layer to obtain more accurate entity boundary recognition results. In order to verify the effectiveness of the model proposed in this paper, we construct Uyghur names dataset (UHND) to train the Chinese NER model, and perform extensive experiments with public Chinese NER data sets. Experimental results show that for UHND, the F1 value is 95.12%, which is 3.09% higher than that of the RoBERTa-WWM-BiGRU-CRF model. For the Resume data set, the Precision and F1 value are 96.28% and 96.10% respectively.
引用
收藏
页码:854 / 867
页数:14
相关论文
共 50 条
  • [41] A Method of Chinese Tourism Named Entity Recognition Based on BBLC Model
    Xue, Leyi
    Cao, Han
    Ye, Fan
    Qin, Yuehua
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 1722 - 1727
  • [42] Chinese Named Entity Recognition of Geological News Based on BERT Model
    Huang, Chao
    Wang, Yuzhu
    Yu, Yuqing
    Hao, Yujia
    Liu, Yuebin
    Zhao, Xiujian
    APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [43] Method of Chinese Named Entity Recognition Based on Maximum Entropy Model
    Ning Hui
    Yang Hua
    Tan Ya-zhou
    Wu Hao
    2009 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS 1-7, CONFERENCE PROCEEDINGS, 2009, : 2472 - 2477
  • [44] Chinese medical named entity recognition model based on local enhancement
    Chen, Jing
    Xing, Kexuan
    Meng, Weilun
    Guo, Jingfeng
    Feng, Jianzhou
    Tongxin Xuebao/Journal on Communications, 45 (07): : 171 - 183
  • [45] TL-NER: A Transfer Learning Model for Chinese Named Entity Recognition
    Peng, DunLu
    Wang, YinRui
    Liu, Cong
    Chen, Zhang
    INFORMATION SYSTEMS FRONTIERS, 2020, 22 (06) : 1291 - 1304
  • [46] TL-NER: A Transfer Learning Model for Chinese Named Entity Recognition
    DunLu Peng
    YinRui Wang
    Cong Liu
    Zhang Chen
    Information Systems Frontiers, 2020, 22 : 1291 - 1304
  • [47] A Sequence Transformation Model for Chinese Named Entity Recognition
    Wang, Qingyue
    Song, Yanjing
    Liu, Hao
    Cao, Yanan
    Liu, Yanbing
    Guo, Li
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2018), PT I, 2018, 11061 : 491 - 502
  • [48] Named Entity Recognition Model of Traditional Chinese Medicine Medical Texts based on Contextual Semantic Enhancement and Adversarial Training
    Ma, Yuekun
    Wen, Moyan
    Liu, He
    IAENG International Journal of Computer Science, 2024, 51 (08) : 1137 - 1143
  • [49] A HMM and FSVMbased model to chinese named entity recognition
    Sun, Xiao
    Journal of Information and Computational Science, 2011, 8 (09): : 1649 - 1657
  • [50] Chinese medical named entity recognition based on zero-shot learning
    Zhou, Menglin
    Gong, Kecun
    2022 5TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND NATURAL LANGUAGE PROCESSING, MLNLP 2022, 2022, : 190 - 195