SpikeLog: Log-Based Anomaly Detection via Potential-Assisted Spiking Neuron Network

被引:2
|
作者
Qi, Jiaxing [1 ]
Luan, Zhongzhi [1 ]
Huang, Shaohan [1 ]
Fung, Carol [2 ]
Yang, Hailong [1 ]
Qian, Depei [1 ]
机构
[1] Beihang Univ, Sino German Joint Software Inst, Beijing 100191, Peoples R China
[2] Concordia Univ, Concordia Inst Informat Syst Engn, Quebec City, PQ H3G1M8, Canada
基金
中国国家自然科学基金;
关键词
Neurons; Anomaly detection; Training; Contamination; Membrane potentials; Computational modeling; Biological neural networks; spiking neural networks; weakly supervised; log analysis; TIME-SERIES; REPRESENTATION; RECOGNITION; VOLUME;
D O I
10.1109/TKDE.2023.3347695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing volume and complexity of log data generated by modern systems have made it challenging to analyze and extract useful insights manually. To address this problem, many machine learning methods have been proposed for log-based anomaly detection. However, most of these methods lack interpretability, and their underlying premises do not always reflect real scenarios. In this paper, we consider a more reasonable premise scenario where a large number of logs are unlabeled, while only a small number of anomalous logs are labeled. Moreover, a small proportion of anomaly contamination may be present. To handle this practical scenario, we propose a novel hybrid potential-assisted framework (SpikeLog) using the membrane potential of spiking neurons. SpikeLog adopts a weakly supervised approach to train an anomaly score model, which effectively utilizes a limited number of labeled anomalies alongside abundant unlabeled logs while ensuring computational efficiency without compromising accuracy. Extensive experiments have demonstrated that SpikeLog outperforms baseline methods in terms of performance, robustness, interpretability, and energy consumption.
引用
收藏
页码:9322 / 9335
页数:14
相关论文
共 50 条
  • [31] Log-based Anomaly Detection with Deep Learning: How Far Are We?
    Le, Van-Hoang
    Zhang, Hongyu
    2022 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2022), 2022, : 1356 - 1367
  • [32] Improving Log-Based Anomaly Detection by Pre-Training Hierarchical Transformers
    Huang, Shaohan
    Liu, Yi
    Fung, Carol
    Wang, He
    Yang, Hailong
    Luan, Zhongzhi
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (09) : 2656 - 2667
  • [33] Virtual Machine Proactive Fault Tolerance Using Log-Based Anomaly Detection
    Senevirathne, Pratheek
    Cooray, Samindu
    Herath, Jerome Dinal
    Fernando, Dinuni
    IEEE ACCESS, 2024, 12 : 178951 - 178970
  • [34] AFALog: A General Augmentation Framework for Log-based Anomaly Detection with Active Learning
    Duan, Chiming
    Jia, Tong
    Cai, Huaqian
    Li, Ying
    Huang, Gang
    2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, ISSRE, 2023, : 46 - 56
  • [35] Hilogx: noise-aware log-based anomaly detection with human feedback
    Tong Jia
    Ying Li
    Yong Yang
    Gang Huang
    The VLDB Journal, 2024, 33 : 883 - 900
  • [36] MoniLog: An Automated Log-Based Anomaly Detection System for Cloud Computing Infrastructures
    Vervaet, Arthur
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2739 - 2743
  • [37] DualAttlog: Context aware dual attention networks for log-based anomaly detection
    Yang, Haitian
    Sun, Degang
    Huang, Weiqing
    NEURAL NETWORKS, 2024, 180
  • [38] Hilogx: noise-aware log-based anomaly detection with human feedback
    Jia, Tong
    Li, Ying
    Yang, Yong
    Huang, Gang
    VLDB JOURNAL, 2024, 33 (03): : 883 - 900
  • [39] Log-based Anomaly Detection from Multi-view by Associating Anomaly Scores with User Trust
    Wang, Lin
    Zhang, Kun
    Li, Chen
    Tu, Bibo
    2021 IEEE 20TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2021), 2021, : 643 - 650
  • [40] Unsupervised Learning and Online Anomaly Detection: An On-Condition Log-Based Maintenance System
    Decker, Leticia
    Leite, Daniel
    Minarini, Francesco
    Tisbeni, Simone Rossi
    Bonacorsi, Daniele
    INTERNATIONAL JOURNAL OF EMBEDDED AND REAL-TIME COMMUNICATION SYSTEMS (IJERTCS), 2022, 13 (01):