Named Entity Recognition for Drone Forensic Using BERT and DistilBERT

被引:8
|
作者
Silalahi, Swardiantara [1 ]
Ahmad, Tohari [1 ]
Studiawan, Hudan [1 ]
机构
[1] Inst Teknol Sepuluh Nopember, Dept Informat, Surabaya, Indonesia
关键词
drone forensic; named entity recognition; transformers neural network; network infrastructure; BERT; DistilBERT;
D O I
10.1109/ICoDSA55874.2022.9862916
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increase in UAV usage and popularity in many fields opens new opportunities and challenges. Many business sectors are benefiting from the UAV device employment. The wide range of drone implementation is varied, from business purposes to crime. Hence, further mechanisms are needed to deal with drone crime and attacks both administratively and technically. From a technical view, the security protocol is needed to keep the drone safe from various logical or physical attacks. In case a drone experiences incidents, a forensic protocol is needed to perform analysis and investigation to uncover the incident, understand the attack behavior, and mitigate the incident risk. Among the existing drone forensic research efforts, there is limited attempt to utilize specific drone artifacts to perform forensic analysis. Therefore, this paper investigates the potential of NER (Named Entity Recognition) as an initial step to perform information extraction from drone flight logs data. We use Transformers-based techniques to perform NER and assist the forensic investigation. BERT and DistilBERT pre-trained models are fine-tuned using the annotated data and get the F1 scores of 98.63% and of 95.9%, respectively.
引用
收藏
页码:53 / 58
页数:6
相关论文
共 50 条
  • [31] Named entity recognition in human nutrition and health domain using rule and BERT-FLAT
    Zheng L.
    Ren L.
    1600, Chinese Society of Agricultural Engineering (37): : 211 - 218
  • [32] A Named Entity Recognition Approach for Electronic Medical Records Using BERT Semantic Enhancement and BiLSTM
    Lai, Xuewei
    Jie, Qingqing
    INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2023, 19 (01)
  • [33] Aviation-BERT-NER: Named Entity Recognition for Aviation Safety Reports
    Chandra, Chetan
    Ojima, Yuga
    Bendarkar, Mayank V.
    Mavris, Dimitri N.
    AEROSPACE, 2024, 11 (11)
  • [34] Named entity recognition in thangka field based on bert-bilstm-crf-a
    Guo, Xiaoran
    Cheng, Sujie
    Wang, Weilan
    UPB Scientific Bulletin, Series C: Electrical Engineering and Computer Science, 2021, 83 (01): : 161 - 174
  • [35] Med-BERT: A Pretraining Framework for Medical Records Named Entity Recognition
    Liu, Ning
    Hu, Qian
    Xu, Huayun
    Xu, Xing
    Chen, Mengxin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) : 5600 - 5608
  • [36] KGNER: Improving Chinese Named Entity Recognition by BERT Infused with the Knowledge Graph
    Hu, Weiwei
    He, Liang
    Ma, Hanhan
    Wang, Kai
    Xiao, Jingfeng
    APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [37] Lexicon Graph Adapter Based BERT Model for Chinese Named Entity Recognition
    Liu, Jie
    Liu, Peipei
    Ren, Yimo
    Wang, Jinfa
    Zhu, Hongsong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT V, KSEM 2024, 2024, 14888 : 95 - 105
  • [38] A BERT-Span model for Chinese named entity recognition in rehabilitation medicine
    Zhong, Jinhong
    Xuan, Zhanxiang
    Wang, Kang
    Cheng, Zhou
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [39] Chinese agricultural diseases named entity recognition based on BERT-CRF
    Zhang, Suoxiang
    Zhao, Ming
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1144 - 1147
  • [40] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988