Named Entity Recognition in Aviation Products Domain Based on BERT

被引:0
|
作者
Yang, Mingye [1 ]
Namoano, Bernadin [1 ]
Farsi, Maryam [1 ]
Erkoyuncu, John Ahmet [1 ]
机构
[1] Cranfield Univ, Ctr Digital Engn & Mfg, Cranfield MK43 0AL, England
来源
IEEE ACCESS | 2024年 / 12卷
基金
英国工程与自然科学研究理事会;
关键词
Hidden Markov models; Data models; Named entity recognition; Knowledge graphs; Atmospheric modeling; Feature extraction; Data mining; Ontologies; Encoding; Biological system modeling; Aviation; named entity recognition (NER); knowledge graph; bidirectional encoder representations from transformers (BERT); bidirectional long short-term memory network (Bi-LSTM);
D O I
10.1109/ACCESS.2024.3516390
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The aviation products' manufacturing industry is undergoing a profound transformation towards intelligence, among which the construction of a knowledge graph specifically for the aviation field has become the core link in achieving cognitive intelligence. In the process of knowledge graph construction, named entity recognition (NER) is a key step and one of the main tasks of knowledge extraction. Given the high degree of specialisation of aviation product text data and the wide span of contextual information, existing models often perform poorly in entity extraction. This paper proposes a new Named Entity Recognition (NER) method specifically tailored for the aviation product field (BBC-Ap), introducing an innovative approach that leverages domain-specific ontologies and advanced deep learning algorithms to significantly enhance the accuracy and efficiency of entity extraction from complex technical documents. The first step of this method is to establish an ontology model of aviation products and annotate the relevant text data to form a dataset for training the named entity model. Next, it adopts a multi-level model structure based on BERT, in which BERT is used to generate word vector representations, a bidirectional long short-term memory network (BiLSTM) is used as an encoder to extract semantic features, and a conditional random field (CRF) is used as a decoder to achieve optimal label assignment. Through experiments on the constructed aviation product dataset, the model achieved a Precision value of 91.74%, a Recall value of 92.46%, and an F1 score of 92.1%, Compared with other baseline models, the F1-score is improved by 0.9% to 1.5%. At the same time, the model also performs well on standard datasets such as CoNLLpp, with a Precision value of 92.87%, a Recall value of 92.54%, and an F1-Score of 92.70%. Finally, the model was used to successfully construct a knowledge graph reflecting the relationships between aviation products in Neo4j, further demonstrating the effectiveness and practicality of the method.
引用
收藏
页码:189710 / 189721
页数:12
相关论文
共 50 条
  • [21] Lexicon Graph Adapter Based BERT Model for Chinese Named Entity Recognition
    Liu, Jie
    Liu, Peipei
    Ren, Yimo
    Wang, Jinfa
    Zhu, Hongsong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT V, KSEM 2024, 2024, 14888 : 95 - 105
  • [22] Chinese agricultural diseases named entity recognition based on BERT-CRF
    Zhang, Suoxiang
    Zhao, Ming
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1144 - 1147
  • [23] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [24] Chinese Named Entity Recognition Based on BERT and Lightweight Feature Extraction Model
    Yang, Ruisen
    Gan, Yong
    Zhang, Chenfang
    INFORMATION, 2022, 13 (11)
  • [25] Chinese Named Entity Recognition Method in History and Culture Field Based on BERT
    Shuang Liu
    Hui Yang
    Jiayi Li
    Simon Kolmanič
    International Journal of Computational Intelligence Systems, 14
  • [26] Geotechnical Named Entity Recognition Based on BERT-BiGRU-CRF Model
    Quanyu W.
    Li Z.
    Tu Z.
    Chen G.
    Hu J.
    Chen J.
    Chen J.
    Lv G.
    Diqiu Kexue - Zhongguo Dizhi Daxue Xuebao/Earth Science - Journal of China University of Geosciences, 2023, 48 (08): : 3137 - 3150
  • [27] NAMED ENTITY RECOGNITION IN THANGKA FIELD BASED ON BERT-BiLSTM-CRF-a
    Guo, Xiaoran
    Cheng, Sujie
    Wang, Weilan
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2021, 83 (01): : 161 - 174
  • [28] Chinese Named Entity Recognition Method in History and Culture Field Based on BERT
    Liu, Shuang
    Yang, Hui
    Li, Jiayi
    Kolmanic, Simon
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2021, 14 (01)
  • [29] BOND: BERT-Assisted Open-Domain Named Entity Recognition with Distant Supervision
    Liang, Chen
    Yu, Yue
    Jiang, Haoming
    Er, Siawpeng
    Wang, Ruijia
    Zhao, Tuo
    Zhang, Chao
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1054 - 1064
  • [30] Named entity recognition in human nutrition and health domain using rule and BERT-FLAT
    Zheng L.
    Ren L.
    1600, Chinese Society of Agricultural Engineering (37): : 211 - 218