Chinese Named Entity Recognition for Automobile Fault Texts Based on External Context Retrieving and Adversarial Training

被引:0
|
作者
Wang, Shuhai [1 ,2 ]
Sun, Linfu [1 ,2 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Peoples R China
[2] Southwest Jiaotong Univ, Mfg Ind Chain Collaborat & Informat Support Techno, Chengdu 610031, Peoples R China
关键词
automobile fault text; named entity recognition; adversarial training; bidirectional long short-term memory; information entropy;
D O I
10.3390/e27020133
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Identifying key concepts in automobile fault texts is crucial for understanding fault causes and enabling diagnosis. However, effective mining tools are lacking, leaving much latent information unexplored. To solve the problem, this paper proposes Chinese named entity recognition for automobile fault texts based on external context retrieval and adversarial training. First, we retrieve external contexts by using a search engine. Then, the input sentence and its external contexts are respectively fed into Lexicon Enhanced BERT to improve the text embedding representation. Furthermore, the input sentence and its external contexts embedding representation are fused through the attention mechanism. Then, adversarial samples are generated by adding perturbations to the fusion vector representation. Finally, the fusion vector representation and adversarial samples are input into the BiLSTM-CRF layer as training data for entity labeling. Our model is evaluated on the automotive fault datasets, Weibo and Resume datasets, and achieves state-of-the-art results.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Chinese Named Entity Recognition and Disambiguation Based on Wikipedia
    Yu Miao
    Lv Yajuan
    Liu Qun
    Su Jinsong
    Xiong Hao
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, 2012, 333 : 272 - 283
  • [32] Research on Chinese Named Entity Recognition Based on Ontology
    Chang, Weili
    Luo, Fang
    Qian, Jilai
    MECHANICAL ENGINEERING AND INTELLIGENT SYSTEMS, PTS 1 AND 2, 2012, 195-196 : 1180 - 1185
  • [33] Chinese Chemical Named Entity Recognition Based on Morpheme
    Wang, Guirong
    Xia, Bo
    Xiao, Ye
    Rao, Gaoqi
    Xun, Endong
    2020 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2020), 2020, : 247 - 252
  • [34] Chinese named entity recognition model based on BERT
    Liu, Hongshuai
    Jun, Ge
    Zheng, Yuanyuan
    2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336
  • [35] Chinese named entity recognition based on Transformer encoder
    Guo X.-R.
    Luo P.
    Wang W.-L.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2021, 51 (03): : 989 - 995
  • [36] IBNNER: A Biaffine Model-Based Chinese Nested Named Entity Recognition Method for Medical Texts
    Lu, Ping
    Shao, Chongkun
    Deng, Shan
    Zeng, Jiaying
    Lin, Kaibiao
    IAENG International Journal of Computer Science, 2024, 51 (11) : 1686 - 1699
  • [37] Unsupervised cross-domain named entity recognition using entity-aware adversarial training
    Peng, Qi
    Zheng, Changmeng
    Cai, Yi
    Wang, Tao
    Xie, Haoran
    Li, Qing
    NEURAL NETWORKS, 2021, 138 (138) : 68 - 77
  • [38] Multifeature Named Entity Recognition in Information Security Based on Adversarial Learning
    Zhang, Han
    Guo, Yuanbo
    Li, Tao
    SECURITY AND COMMUNICATION NETWORKS, 2019,
  • [39] Adversarial Transfer Learning for Chinese Named Entity Recognition with Self-Attention Mechanism
    Cao, Pengfei
    Chen, Yubo
    Liu, Kang
    Zhao, Jun
    Liu, Shengping
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 182 - 192
  • [40] Cross domains adversarial learning for Chinese named entity recognition for online medical consultation
    Wen, Guihua
    Chen, Hehong
    Li, Huihui
    Hu, Yang
    Li, Yanghui
    Wang, Changjun
    JOURNAL OF BIOMEDICAL INFORMATICS, 2020, 112