Research on Named Entity Recognition Method Based on BERT Model

被引:0
|
作者
Xie, Shaopeng [1 ]
机构
[1] Shanghai Vocat Coll Sci & Technol, Shanghai, Peoples R China
关键词
NER; BERT; bi-LSTM;
D O I
10.1109/BigDataService62917.2024.00020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Named Entity Recognition (NER), as a fundamental task in the field of natural language processing, directly determines the efficiency and accuracy of semantic processing and inference in subsequent tasks. In previous studies, the Bi-LSTM model has demonstrated relatively mature and stable performance in entity extraction tasks. However, with the continuous evolution of technology, pre-trained models have now become the preferred choice for mainstream NLP tasks. In this study, based on five publicly annotated datasets, we conducted an in-depth comparison between the Bi-LSTM and BERT models in the task of named entity recognition. We found that in four out of the five datasets, the performance of the BERT model was superior to that of Bi-LSTM. This result fully demonstrates the excellent performance of pre-trained models in the field of named entity recognition, especially when dealing with large-scale and complex textual data, where their performance is even more outstanding. Thanks to pre-trained models, which are trained on large-scale corpora, they can learn rich language rules and knowledge, thereby more accurately capturing deep semantic information in text and improving the accuracy and efficiency of recognition.
引用
收藏
页码:92 / 96
页数:5
相关论文
共 50 条
  • [31] Research on the Chinese Named-Entity-Relation-Extraction Method for Crop Diseases Based on BERT
    Zhang, Wenhao
    Wang, Chunshan
    Wu, Huarui
    Zhao, Chunjiang
    Teng, Guifa
    Huang, Sufang
    Liu, Zhen
    AGRONOMY-BASEL, 2022, 12 (09):
  • [32] Research on Named Entity Recognition Method for Commodity Review
    Qiu, Zenghui
    He, Mingjie
    Lin, Zhengkui
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 304 - 305
  • [33] Method of Chinese Named Entity Recognition Based on Maximum Entropy Model
    Ning Hui
    Yang Hua
    Tan Ya-zhou
    Wu Hao
    2009 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS 1-7, CONFERENCE PROCEEDINGS, 2009, : 2472 - 2477
  • [34] A Method of Chinese Tourism Named Entity Recognition Based on BBLC Model
    Xue, Leyi
    Cao, Han
    Ye, Fan
    Qin, Yuehua
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 1722 - 1727
  • [35] Named entity recognition in thangka field based on bert-bilstm-crf-a
    Guo, Xiaoran
    Cheng, Sujie
    Wang, Weilan
    UPB Scientific Bulletin, Series C: Electrical Engineering and Computer Science, 2021, 83 (01): : 161 - 174
  • [36] Text Summarization based Named Entity Recognition for Certain Application using BERT
    Tummala, Indira Priyadarshini
    2024 SECOND INTERNATIONAL CONFERENCE ON INTELLIGENT CYBER PHYSICAL SYSTEMS AND INTERNET OF THINGS, ICOICI 2024, 2024, : 1136 - 1141
  • [37] Chinese agricultural diseases named entity recognition based on BERT-CRF
    Zhang, Suoxiang
    Zhao, Ming
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1144 - 1147
  • [38] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [39] NAMED ENTITY RECOGNITION IN THANGKA FIELD BASED ON BERT-BiLSTM-CRF-a
    Guo, Xiaoran
    Cheng, Sujie
    Wang, Weilan
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2021, 83 (01): : 161 - 174
  • [40] Using BERT and Augmentation in Named Entity Recognition for Cybersecurity Domain
    Tikhomirov, Mikhail
    Loukachevitch, N.
    Sirotina, Anastasiia
    Dobrov, Boris
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2020), 2020, 12089 : 16 - 24