LMGD: Log-Metric Combined Microservice Anomaly Detection Through Graph-Based Deep Learning

被引:0
|
作者
Liu, Xu [1 ]
Liu, Yuewen [2 ]
Wei, Miaomiao [2 ]
Xu, Peng [2 ]
机构
[1] China Acad Ind Internet, Beijing 100083, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Microservice architectures; Anomaly detection; Measurement; Long short term memory; Logic gates; Monitoring; Data models; Real-time systems; Vectors; Predictive models; log; metrics; distributed systems; GCN; GAT;
D O I
10.1109/ACCESS.2024.3481676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a high-cohesion and low-coupling software architecture. Its core idea is to split the application into a set of microservices with a single function and independent deployment. Due to their complexity and large scale, microservice systems are typically fragile and failures are inevitable. Therefore, there is an urgent need for fast and accurate anomaly detection capabilities. However, the existing microservice anomaly detection methods do not pay attention to the multi-source data of the microservice system and thus have low accuracy. To address this limitation, we propose a Log-Metric Combined Microservice Anomaly Detection approach through Graph-based Deep Learning (termed as LMGD). First, we propose a time-aware LSTM prediction neural network to improve the accuracy of service dependency mining. Secondly, based on the service dependency graph, we propose an anomaly detection method based on log-metric fusion, which can more accurately describe the running status of microservices, thereby improving the accuracy of anomaly detection. The experimental outcomes demonstrate that compared with other state-of-the-art methods, our method improves recall and F1-score by 2.63% and 1.05%.
引用
收藏
页码:186510 / 186519
页数:10
相关论文
共 50 条
  • [31] Graph-based Correlation of SNMP Objects for Anomaly Detection
    Zarpelao, Bruno Bogaz
    Mendes, Leonardo de Souza
    Proenca, Mario Lemes, Jr.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2006, 6 (5B): : 194 - 202
  • [32] Evolving graph-based video crowd anomaly detection
    Meng Yang
    Yanghe Feng
    Aravinda S. Rao
    Sutharshan Rajasegarar
    Shucong Tian
    Zhengchun Zhou
    The Visual Computer, 2024, 40 : 303 - 318
  • [33] A robust Wide & Deep learning framework for log-based anomaly detection
    Niu, Weina
    Liao, Xuhan
    Huang, Shiping
    Li, Yudong
    Zhang, Xiaosong
    Li, Beibei
    APPLIED SOFT COMPUTING, 2024, 153
  • [34] LogCTBL: a hybrid deep learning model for log-based anomaly detection
    Huang, Hong
    Luo, Wengang
    Wang, Yunfei
    Zhou, Yinghang
    Huang, Weitao
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (02):
  • [35] Log-based Anomaly Detection with Deep Learning: How Far Are We?
    Le, Van-Hoang
    Zhang, Hongyu
    2022 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2022), 2022, : 1356 - 1367
  • [36] A joint model based on graph and deep learning for hyperspectral anomaly detection
    Zhang, Lili
    Lin, Fang
    Fu, Baohong
    INFRARED PHYSICS & TECHNOLOGY, 2024, 139
  • [37] Graph Deep Learning Based Anomaly Detection in Ethereum Blockchain Network
    Patel, Vatsal
    Pan, Lei
    Rajasegarar, Sutharshan
    NETWORK AND SYSTEM SECURITY, NSS 2020, 2020, 12570 : 132 - 148
  • [38] Graph-based domain adversarial learning framework for video anomaly detection domain generalization
    Mei, Xue
    Wei, Yachuan
    Chen, Haoyang
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18977 - 19002
  • [39] Graph-based deep learning for graphics classification
    Riba, Pau
    Dutta, Anjan
    Llados, Josep
    Fornes, Alicia
    2017 14TH IAPR INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR 2017), VOL 2, 2017, : 29 - 30
  • [40] LogEDL: Log Anomaly Detection via Evidential Deep Learning
    Duan, Yunfeng
    Xue, Kaiwen
    Sun, Hao
    Bao, Haotong
    Wei, Yadong
    You, Zhangzheng
    Zhang, Yuantian
    Jiang, Xiwei
    Yang, Sangning
    Chen, Jiaxing
    Duan, Boya
    Ou, Zhonghong
    APPLIED SCIENCES-BASEL, 2024, 14 (16):