Network Fault Lightweight Prediction Algorithm Based on Continuous Knowledge Distillation

被引:0
|
作者
Huang, Wei [1 ,2 ]
Huang, Jie [1 ]
Fan, Chengwen [3 ]
Yang, Yang [3 ]
机构
[1] Southeast Univ, Sch Cyber Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] CETC, Res Inst 54, Shijiazhuang, Hebei, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
关键词
Knowledge distillation; Fault prediction; Lightweight method; BiLSTM;
D O I
10.1007/978-981-99-9247-8_31
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Network fault prediction is one of the important means to ensure network security and stable operation. Efficient fault prediction can improve the ability of operation and maintenance personnel to deal with faults and reduce losses caused by faults. In edge scenarios, device resources may be limited by hardware resources, such as storage space, memory, processing power. They may also be limited by unstable network connections, such as limited bandwidth, high packet loss rate, and large delay. This paper investigates the research status of network fault prediction at home and abroad. Currently, commonly used network fault prediction methods include methods based on statistics, based on machine learning, and based on deep learning. These network fault prediction methods can learn the characteristics of network faults and have achieved good results in network fault prediction tasks. However, the methods based on neural networks have a large computational resource overhead and are easily limited by device performance in edge scenarios. The methods based on statistics and machine learning have low cost but low accuracy. In this paper, an edge side network fault prediction model based on improved BiLSTM is designed, and improve the continuous distillation technology to design Stage Continuous Knowledge Distillation (SCKD). The simulation experiments prove that the student model performs similarly to the teacher model in terms of accuracy and F1-Score, and has lower memory usage and parameter volume.
引用
收藏
页码:316 / 325
页数:10
相关论文
共 50 条
  • [31] Knowledge distillation based lightweight domain adversarial neural network for electroencephalogram-based emotion recognition
    Wang, Zhe
    Wang, Yongxiong
    Tang, Yiheng
    Pan, Zhiqun
    Zhang, Jiapeng
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [32] Research on Lightweight Spine X-ray Image Segmentation Algorithm Based on Knowledge Distillation
    Qing, Dong
    Qi, Li
    PROCEEDINGS OF 2024 4TH INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND INTELLIGENT COMPUTING, BIC 2024, 2024, : 142 - 146
  • [33] Focus-RCNet: a lightweight recyclable waste classification algorithm based on focus and knowledge distillation
    Zheng, Dashun
    Wang, Rongsheng
    Duan, Yaofei
    Pang, Patrick Cheong-Iao
    Tan, Tao
    VISUAL COMPUTING FOR INDUSTRY BIOMEDICINE AND ART, 2023, 6 (01)
  • [34] A Lightweight and Adaptive Knowledge Distillation Framework for Remaining Useful Life Prediction
    Ren, Lei
    Wang, Tao
    Jia, Zidi
    Li, Fangyu
    Han, Honggui
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (08) : 9060 - 9070
  • [35] Fault prediction for distribution network based on CNN and LightGBM algorithm
    Fan Min
    Liu Yaling
    Zhang Xi
    Chen Huan
    Hu Yaqian
    Fan Libo
    Yang Qing
    PROCEEDINGS OF 2019 14TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), 2019, : 1020 - 1026
  • [36] A Lightweight Identification Method for Complex Power Industry Tasks Based on Knowledge Distillation and Network Pruning
    Wang, Wendi
    Zhou, Xiangling
    Jiang, Chengling
    Zhu, Hong
    Yu, Hao
    Wang, Shufan
    PROCESSES, 2023, 11 (09)
  • [37] A Lightweight SAR Ship Detection Network Based on Deep Multiscale Grouped Convolution, Network Pruning, and Knowledge Distillation
    Hu, Boyi
    Miao, Hongxia
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 2190 - 2207
  • [38] A knowledge distillation-based deep interaction compressed network for CTR prediction
    Guan, Fei
    Qian, Cheng
    He, Feiyan
    KNOWLEDGE-BASED SYSTEMS, 2023, 275
  • [39] BearingPGA-Net: A Lightweight and Deployable Bearing Fault Diagnosis Network via Decoupled Knowledge Distillation and FPGA Acceleration
    Liao, Jing-Xiao
    Wei, Sheng-Lai
    Xie, Chen-Long
    Zeng, Tieyong
    Sun, Jinwei
    Zhang, Shiping
    Zhang, Xiaoge
    Fan, Feng-Lei
    IEEE Transactions on Instrumentation and Measurement, 2024, 73 : 1 - 14
  • [40] BearingPGA-Net: A Lightweight and Deployable Bearing Fault Diagnosis Network via Decoupled Knowledge Distillation and FPGA Acceleration
    Liao, Jing-Xiao
    Wei, Sheng-Lai
    Xie, Chen-Long
    Zeng, Tieyong
    Sun, Jinwei
    Zhang, Shiping
    Zhang, Xiaoge
    Fan, Feng-Lei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 14