A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

被引:6
|
作者
Zhang Yangsen [1 ]
Li Jianlong [1 ]
Xin Yonghui [2 ]
Zhao Xiquan [1 ]
Liu Yang [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Inst Intelligent Informat Proc, Beijing 100192, Peoples R China
[2] Coordinat Ctr China, Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition (NER); Global pointer; RoBERTa-WWM model; Fast gradient method (FGM); BiGRU;
D O I
10.23919/cje.2022.00.279
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To solve the problem that the Chinese named entity recognition (NER) models have poor anti-interference ability and inaccurate entity boundary recognition, this paper proposes the RGP-with-FGM model which is based on global pointer and adversarial learning. Firstly, the RoBERTa-WWM model is used to optimize the semantic representation of the text, and fast gradient method is used to add perturbation to the word embedding layer to enhance the robustness of the model. Then, BiGRU is used to focus on the timing information of Chinese characters to enhance the semantic connection. Finally, the global pointer is constructed in the decoding layer to obtain more accurate entity boundary recognition results. In order to verify the effectiveness of the model proposed in this paper, we construct Uyghur names dataset (UHND) to train the Chinese NER model, and perform extensive experiments with public Chinese NER data sets. Experimental results show that for UHND, the F1 value is 95.12%, which is 3.09% higher than that of the RoBERTa-WWM-BiGRU-CRF model. For the Resume data set, the Precision and F1 value are 96.28% and 96.10% respectively.
引用
收藏
页码:854 / 867
页数:14
相关论文
共 50 条
  • [21] Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer
    Lei Zhang
    Pengfei Xia
    Xiaoxuan Ma
    Chengwei Yang
    Xin Ding
    Complex & Intelligent Systems, 2024, 10 : 4473 - 4491
  • [22] A named entity recognition model based on ensemble learning
    Zhu, Xinghui
    Zou, Zhuoyang
    Qiao, Bo
    Fang, Kui
    Chen, Yiming
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2021, 21 (02) : 475 - 486
  • [23] Cross domains adversarial learning for Chinese named entity recognition for online medical consultation
    Wen, Guihua
    Chen, Hehong
    Li, Huihui
    Hu, Yang
    Li, Yanghui
    Wang, Changjun
    JOURNAL OF BIOMEDICAL INFORMATICS, 2020, 112
  • [24] Named entity recognition based on a machine learning model
    Wang, Jing
    Liu, Zhijing
    Zhao, Hui
    Research Journal of Applied Sciences, Engineering and Technology, 2012, 4 (20) : 3973 - 3980
  • [25] A Chinese Nested Named Entity Recognition Model for Chicken Disease Based on Multiple Fine-Grained Feature Fusion and Efficient Global Pointer
    Wang, Xiajun
    Peng, Cheng
    Li, Qifeng
    Yu, Qinyang
    Lin, Liqun
    Li, Pingping
    Gao, Ronghua
    Wu, Wenbiao
    Jiang, Ruixiang
    Yu, Ligen
    Ding, Luyu
    Zhu, Lei
    APPLIED SCIENCES-BASEL, 2024, 14 (18):
  • [26] Multitask Learning for Chinese Named Entity Recognition
    Zhang, Qun
    Li, Zhenzhen
    Feng, Dawei
    Li, Dongsheng
    Huang, Zhen
    Peng, Yuxing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 653 - 662
  • [27] An imConvNet-based deep learning model for Chinese medical named entity recognition
    Zheng, Yuchen
    Han, Zhenggong
    Cai, Yimin
    Duan, Xubo
    Sun, Jiangling
    Yang, Wei
    Huang, Haisong
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2022, 22 (01)
  • [28] A Named Entity Recognition Model Based on Entity Trigger Reinforcement Learning
    Wang, Ping
    Si, Nong
    Tong, Haopeng
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE (CCAI 2022), 2022, : 43 - 48
  • [29] An imConvNet-based deep learning model for Chinese medical named entity recognition
    Yuchen Zheng
    Zhenggong Han
    Yimin Cai
    Xubo Duan
    Jiangling Sun
    Wei Yang
    Haisong Huang
    BMC Medical Informatics and Decision Making, 22
  • [30] Chinese mineral named entity recognition based on BERT model
    Yu, Yuqing
    Wang, Yuzhu
    Mua, Jingqin
    Li, Wei
    Jiao, Shoutao
    Wang, Zhenhua
    Lv, Pengfei
    Zhu, Yueqin
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 206