Research on Named Entity Recognition Method Based on BERT Model

被引:0
|
作者
Xie, Shaopeng [1 ]
机构
[1] Shanghai Vocat Coll Sci & Technol, Shanghai, Peoples R China
关键词
NER; BERT; bi-LSTM;
D O I
10.1109/BigDataService62917.2024.00020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Named Entity Recognition (NER), as a fundamental task in the field of natural language processing, directly determines the efficiency and accuracy of semantic processing and inference in subsequent tasks. In previous studies, the Bi-LSTM model has demonstrated relatively mature and stable performance in entity extraction tasks. However, with the continuous evolution of technology, pre-trained models have now become the preferred choice for mainstream NLP tasks. In this study, based on five publicly annotated datasets, we conducted an in-depth comparison between the Bi-LSTM and BERT models in the task of named entity recognition. We found that in four out of the five datasets, the performance of the BERT model was superior to that of Bi-LSTM. This result fully demonstrates the excellent performance of pre-trained models in the field of named entity recognition, especially when dealing with large-scale and complex textual data, where their performance is even more outstanding. Thanks to pre-trained models, which are trained on large-scale corpora, they can learn rich language rules and knowledge, thereby more accurately capturing deep semantic information in text and improving the accuracy and efficiency of recognition.
引用
收藏
页码:92 / 96
页数:5
相关论文
共 50 条
  • [41] Arabic Named Entity Recognition: A BERT-BGRU Approach
    Alsaaran, Norah
    Alrabiah, Maha
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 471 - 485
  • [42] Named Entity Recognition for Drone Forensic Using BERT and DistilBERT
    Silalahi, Swardiantara
    Ahmad, Tohari
    Studiawan, Hudan
    2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA), 2022, : 53 - 58
  • [43] Named Entity Recognition of Enterprise Annual Report Integrated with BERT
    Zhang J.
    He G.
    Dai Z.
    Liu Y.
    Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University, 2021, 55 (02): : 117 - 123
  • [44] Geographic Named Entity Recognition by Employing Natural Language Processing and an Improved BERT Model
    Tao, Liufeng
    Xie, Zhong
    Xu, Dexin
    Ma, Kai
    Qiu, Qinjun
    Pan, Shengyong
    Huang, Bo
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (12)
  • [45] Research on Chinese Named Entity Recognition Based on Ontology
    Chang, Weili
    Luo, Fang
    Qian, Jilai
    MECHANICAL ENGINEERING AND INTELLIGENT SYSTEMS, PTS 1 AND 2, 2012, 195-196 : 1180 - 1185
  • [46] Named entity recognition of agricultural based entity-level masking BERT and BiLSTM-CRF
    Wei Z.
    Song L.
    Hu X.
    Chen N.
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (15): : 195 - 203
  • [47] A Chinese BERT-Based Dual-Channel Named Entity Recognition Method for Solid Rocket Engines
    Zheng, Zhiqiang
    Liu, Minghao
    Weng, Zhi
    ELECTRONICS, 2023, 12 (03)
  • [48] Pattern based bootstrapping method for named entity recognition
    Ekbal, Asif
    Bandyopadhyay, Sivaji
    PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION, 2007, : 349 - +
  • [49] Chinese named entity recognition method based on Transformer and hidden Markov model
    Li J.
    Xiong Q.
    Hu Y.-T.
    Liu K.-Y.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (05): : 1427 - 1434
  • [50] Domain Named Entity Recognition Method Based on Skip-gram Model
    Feng Yan-hong
    Yu Hong
    Sun Geng
    Yu Xun-ran
    PROCEEDINGS FIRST INTERNATIONAL CONFERENCE ON ELECTRONICS INSTRUMENTATION & INFORMATION SYSTEMS (EIIS 2017), 2017, : 510 - 514