Network Fault Lightweight Prediction Algorithm Based on Continuous Knowledge Distillation

被引:0
|
作者
Huang, Wei [1 ,2 ]
Huang, Jie [1 ]
Fan, Chengwen [3 ]
Yang, Yang [3 ]
机构
[1] Southeast Univ, Sch Cyber Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] CETC, Res Inst 54, Shijiazhuang, Hebei, Peoples R China
[3] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
关键词
Knowledge distillation; Fault prediction; Lightweight method; BiLSTM;
D O I
10.1007/978-981-99-9247-8_31
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Network fault prediction is one of the important means to ensure network security and stable operation. Efficient fault prediction can improve the ability of operation and maintenance personnel to deal with faults and reduce losses caused by faults. In edge scenarios, device resources may be limited by hardware resources, such as storage space, memory, processing power. They may also be limited by unstable network connections, such as limited bandwidth, high packet loss rate, and large delay. This paper investigates the research status of network fault prediction at home and abroad. Currently, commonly used network fault prediction methods include methods based on statistics, based on machine learning, and based on deep learning. These network fault prediction methods can learn the characteristics of network faults and have achieved good results in network fault prediction tasks. However, the methods based on neural networks have a large computational resource overhead and are easily limited by device performance in edge scenarios. The methods based on statistics and machine learning have low cost but low accuracy. In this paper, an edge side network fault prediction model based on improved BiLSTM is designed, and improve the continuous distillation technology to design Stage Continuous Knowledge Distillation (SCKD). The simulation experiments prove that the student model performs similarly to the teacher model in terms of accuracy and F1-Score, and has lower memory usage and parameter volume.
引用
收藏
页码:316 / 325
页数:10
相关论文
共 50 条
  • [41] Lightweight convolutional neural network with knowledge distillation for cervical cells classification
    Chen, Wen
    Gao, Liang
    Li, Xinyu
    Shen, Weiming
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 71
  • [42] Adaptive lightweight network construction method for Self-Knowledge Distillation
    Lu, Siyuan
    Zeng, Weiliang
    Li, Xueshi
    Ou, Jiajun
    NEUROCOMPUTING, 2025, 624
  • [43] Reconstructed Graph Neural Network With Knowledge Distillation for Lightweight Anomaly Detection
    Zhou, Xiaokang
    Wu, Jiayi
    Liang, Wei
    Wang, Kevin I-Kai
    Yan, Zheng
    Yang, Laurence T.
    Jin, Qun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 11817 - 11828
  • [44] Lightweight intelligent fault diagnosis method based on a multi-stage pruning distillation interleaving network
    Ren, Linlin
    Li, Xiaoming
    Ma, Hongbo
    Zhang, Guowei
    Huang, Song
    Chen, Ke
    Wang, Xiaoqing
    Yue, Weijie
    ADVANCES IN MECHANICAL ENGINEERING, 2024, 16 (09)
  • [45] Lightweight Underwater Target Detection Algorithm Based on Dynamic Sampling Transformer and Knowledge-Distillation Optimization
    Chen, Liang
    Yang, Yuyi
    Wang, Zhenheng
    Zhang, Jian
    Zhou, Shaowu
    Wu, Lianghong
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (02)
  • [46] An Efficient and Lightweight Approach for Intrusion Detection based on Knowledge Distillation
    Zhao, Ruijie
    Chen, Yu
    Wang, Yijun
    Shi, Yong
    Xue, Zhi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [47] Lightweight intrusion detection model based on CNN and knowledge distillation
    Wang, Long-Hui
    Dai, Qi
    Du, Tony
    Chen, Li-fang
    APPLIED SOFT COMPUTING, 2024, 165
  • [48] A Lightweight Android Malware Detection Framework Based on Knowledge Distillation
    Zhi, Yongbo
    Xi, Ning
    Liu, Yuanqing
    Hui, Honglei
    NETWORK AND SYSTEM SECURITY, NSS 2021, 2021, 13041 : 116 - 130
  • [49] Lightweight image dehazing networks based on soft knowledge distillation
    Tran, Le-Anh
    Park, Dong-Chul
    VISUAL COMPUTER, 2024, : 4047 - 4066
  • [50] Lightweight remote sensing scene classification based on knowledge distillation
    Zhang, Chong-Yang
    Wang, Bin
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2024, 43 (05) : 684 - 695