SpikeLog: Log-Based Anomaly Detection via Potential-Assisted Spiking Neuron Network

被引:2
|
作者
Qi, Jiaxing [1 ]
Luan, Zhongzhi [1 ]
Huang, Shaohan [1 ]
Fung, Carol [2 ]
Yang, Hailong [1 ]
Qian, Depei [1 ]
机构
[1] Beihang Univ, Sino German Joint Software Inst, Beijing 100191, Peoples R China
[2] Concordia Univ, Concordia Inst Informat Syst Engn, Quebec City, PQ H3G1M8, Canada
基金
中国国家自然科学基金;
关键词
Neurons; Anomaly detection; Training; Contamination; Membrane potentials; Computational modeling; Biological neural networks; spiking neural networks; weakly supervised; log analysis; TIME-SERIES; REPRESENTATION; RECOGNITION; VOLUME;
D O I
10.1109/TKDE.2023.3347695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The increasing volume and complexity of log data generated by modern systems have made it challenging to analyze and extract useful insights manually. To address this problem, many machine learning methods have been proposed for log-based anomaly detection. However, most of these methods lack interpretability, and their underlying premises do not always reflect real scenarios. In this paper, we consider a more reasonable premise scenario where a large number of logs are unlabeled, while only a small number of anomalous logs are labeled. Moreover, a small proportion of anomaly contamination may be present. To handle this practical scenario, we propose a novel hybrid potential-assisted framework (SpikeLog) using the membrane potential of spiking neurons. SpikeLog adopts a weakly supervised approach to train an anomaly score model, which effectively utilizes a limited number of labeled anomalies alongside abundant unlabeled logs while ensuring computational efficiency without compromising accuracy. Extensive experiments have demonstrated that SpikeLog outperforms baseline methods in terms of performance, robustness, interpretability, and energy consumption.
引用
收藏
页码:9322 / 9335
页数:14
相关论文
共 50 条
  • [41] Augmenting Log-based Anomaly Detection Models to Reduce False Anomalies with Human Feedback
    Jia, Tong
    Li, Ying
    Yang, Yong
    Huang, Gang
    Wu, Zhonghai
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 3081 - 3089
  • [42] Network Log Anomaly Detection Based on GRU and SVDD
    Liu, Shirong
    Chen, Xiong
    Peng, Xingxiong
    Xiao, Ruliang
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1244 - 1249
  • [43] Try with Simpler-An Evaluation of Improved Principal Component Analysis in Log-based Anomaly Detection
    Yang, Lin
    Chen, Junjie
    Gao, Shutao
    Gong, Zhihao
    Zhang, Hongyu
    Kang, Yue
    Li, Huaan
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2024, 33 (05)
  • [44] A Log-Based Anomaly Detection Method with Efficient Neighbor Searching and Automatic K Neighbor Selection
    Wang, Bingming
    Ying, Shi
    Yang, Zhe
    SCIENTIFIC PROGRAMMING, 2020, 2020 (2020)
  • [45] Object detection and tracking method based on spiking neuron network
    Zhou, Jing
    Xiong, Jun
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6811 - 6815
  • [46] Log-based anomaly detection for distributed systems: State of the art, industry experience, and open issues
    Wei, Xinjie
    Wang, Jie
    Sun, Chang-ai
    Towey, Dave
    Zhang, Shoufeng
    Zuo, Wanqing
    Yu, Yiming
    Ruan, Ruoyi
    Song, Guyang
    JOURNAL OF SOFTWARE-EVOLUTION AND PROCESS, 2024, 36 (08)
  • [47] Network Log-Based SSH Brute-Force Attack Detection Model
    Park, Jeonghoon
    Kim, Jinsu
    Gupta, B. B.
    Park, Namje
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (01): : 887 - 901
  • [48] Early Exploration of Using ChatGPT for Log-based Anomaly Detection on Parallel File Systems Logs
    Egersdoerfer, Chris
    Zhang, Di
    Dai, Dong
    PROCEEDINGS OF THE 32ND INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, HPDC 2023, 2023, : 315 - 316
  • [49] LogRep: Log-based Anomaly Detection by Representing both Semantic and Numeric Information in Raw Messages
    Xie, Xiaoda
    Jiang, Songlei
    Huang, Chenlin
    Yu, Fengyuan
    Deng, Yunjia
    2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, ISSRE, 2023, : 195 - 206
  • [50] Communication Network Anomaly Detection Based on Log File Analysis
    Cheng, Xin
    Wang, Ruizhi
    ROUGH SETS AND KNOWLEDGE TECHNOLOGY, RSKT 2014, 2014, 8818 : 240 - 248