Named Entity Recognition in Aviation Products Domain Based on BERT

被引:0
|
作者
Yang, Mingye [1 ]
Namoano, Bernadin [1 ]
Farsi, Maryam [1 ]
Erkoyuncu, John Ahmet [1 ]
机构
[1] Cranfield Univ, Ctr Digital Engn & Mfg, Cranfield MK43 0AL, England
来源
IEEE ACCESS | 2024年 / 12卷
基金
英国工程与自然科学研究理事会;
关键词
Hidden Markov models; Data models; Named entity recognition; Knowledge graphs; Atmospheric modeling; Feature extraction; Data mining; Ontologies; Encoding; Biological system modeling; Aviation; named entity recognition (NER); knowledge graph; bidirectional encoder representations from transformers (BERT); bidirectional long short-term memory network (Bi-LSTM);
D O I
10.1109/ACCESS.2024.3516390
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The aviation products' manufacturing industry is undergoing a profound transformation towards intelligence, among which the construction of a knowledge graph specifically for the aviation field has become the core link in achieving cognitive intelligence. In the process of knowledge graph construction, named entity recognition (NER) is a key step and one of the main tasks of knowledge extraction. Given the high degree of specialisation of aviation product text data and the wide span of contextual information, existing models often perform poorly in entity extraction. This paper proposes a new Named Entity Recognition (NER) method specifically tailored for the aviation product field (BBC-Ap), introducing an innovative approach that leverages domain-specific ontologies and advanced deep learning algorithms to significantly enhance the accuracy and efficiency of entity extraction from complex technical documents. The first step of this method is to establish an ontology model of aviation products and annotate the relevant text data to form a dataset for training the named entity model. Next, it adopts a multi-level model structure based on BERT, in which BERT is used to generate word vector representations, a bidirectional long short-term memory network (BiLSTM) is used as an encoder to extract semantic features, and a conditional random field (CRF) is used as a decoder to achieve optimal label assignment. Through experiments on the constructed aviation product dataset, the model achieved a Precision value of 91.74%, a Recall value of 92.46%, and an F1 score of 92.1%, Compared with other baseline models, the F1-score is improved by 0.9% to 1.5%. At the same time, the model also performs well on standard datasets such as CoNLLpp, with a Precision value of 92.87%, a Recall value of 92.54%, and an F1-Score of 92.70%. Finally, the model was used to successfully construct a knowledge graph reflecting the relationships between aviation products in Neo4j, further demonstrating the effectiveness and practicality of the method.
引用
收藏
页码:189710 / 189721
页数:12
相关论文
共 50 条
  • [1] Chinese Named Entity Recognition in the Geoscience Domain Based on BERT
    Lv, Xia
    Xie, Zhong
    Xu, Dexin
    Jin, Xiangguo
    Ma, Kai
    Tao, Liufeng
    Qiu, Qinjun
    Pan, Yongsheng
    EARTH AND SPACE SCIENCE, 2022, 9 (03)
  • [2] Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports
    Chandra, Chetan
    Ojima, Yuga
    Bendarkar, Mayank V.
    Mavris, Dimitri N.
    AEROSPACE, 2024, 11 (11)
  • [3] Using BERT and Augmentation in Named Entity Recognition for Cybersecurity Domain
    Tikhomirov, Mikhail
    Loukachevitch, N.
    Sirotina, Anastasiia
    Dobrov, Boris
    NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2020), 2020, 12089 : 16 - 24
  • [4] Chinese named entity recognition model based on BERT
    Liu, Hongshuai
    Jun, Ge
    Zheng, Yuanyuan
    2020 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE COMMUNICATION AND NETWORK SECURITY (CSCNS2020), 2021, 336
  • [5] Chinese mineral named entity recognition based on BERT model
    Yu, Yuqing
    Wang, Yuzhu
    Mua, Jingqin
    Li, Wei
    Jiao, Shoutao
    Wang, Zhenhua
    Lv, Pengfei
    Zhu, Yueqin
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 206
  • [6] Continual learning framework of named entity recognition in aviation assembly domain
    Liu P.-F.
    Qian L.
    Zhao X.-W.
    Tao B.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (06): : 1186 - 1194+1266
  • [7] Research on Named Entity Recognition Method Based on BERT Model
    Xie, Shaopeng
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND MACHINE LEARNING APPLICATIONS, BIGDATASERVICE 2024, 2024, : 92 - 96
  • [8] Based on BERT-wwm for Agricultural Named Entity Recognition
    Huang, Qiang
    Tao, Youzhi
    Wu, Zongyuan
    Marinello, Francesco
    AGRONOMY-BASEL, 2024, 14 (06):
  • [9] Telugu named entity recognition using bert
    Gorla, SaiKiranmai
    Tangeda, Sai Sharan
    Neti, Lalita Bhanu Murthy
    Malapati, Aruna
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2022, 14 (02) : 127 - 140
  • [10] Telugu named entity recognition using bert
    SaiKiranmai Gorla
    Sai Sharan Tangeda
    Lalita Bhanu Murthy Neti
    Aruna Malapati
    International Journal of Data Science and Analytics, 2022, 14 : 127 - 140