LMGD: Log-Metric Combined Microservice Anomaly Detection Through Graph-Based Deep Learning

被引:0
|
作者
Liu, Xu [1 ]
Liu, Yuewen [2 ]
Wei, Miaomiao [2 ]
Xu, Peng [2 ]
机构
[1] China Acad Ind Internet, Beijing 100083, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Microservice architectures; Anomaly detection; Measurement; Long short term memory; Logic gates; Monitoring; Data models; Real-time systems; Vectors; Predictive models; log; metrics; distributed systems; GCN; GAT;
D O I
10.1109/ACCESS.2024.3481676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a high-cohesion and low-coupling software architecture. Its core idea is to split the application into a set of microservices with a single function and independent deployment. Due to their complexity and large scale, microservice systems are typically fragile and failures are inevitable. Therefore, there is an urgent need for fast and accurate anomaly detection capabilities. However, the existing microservice anomaly detection methods do not pay attention to the multi-source data of the microservice system and thus have low accuracy. To address this limitation, we propose a Log-Metric Combined Microservice Anomaly Detection approach through Graph-based Deep Learning (termed as LMGD). First, we propose a time-aware LSTM prediction neural network to improve the accuracy of service dependency mining. Secondly, based on the service dependency graph, we propose an anomaly detection method based on log-metric fusion, which can more accurately describe the running status of microservices, thereby improving the accuracy of anomaly detection. The experimental outcomes demonstrate that compared with other state-of-the-art methods, our method improves recall and F1-score by 2.63% and 1.05%.
引用
收藏
页码:186510 / 186519
页数:10
相关论文
共 50 条
  • [1] DeepTraLog: Trace-Log Combined Microservice Anomaly Detection through Graph-based Deep Learning
    Zhang, Chenxi
    Peng, Xin
    Sha, Chaofeng
    Zhang, Ke
    Fu, Zhenqing
    Wu, Xiya
    Lin, Qingwei
    Zhang, Dongmei
    2022 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2022), 2022, : 623 - 634
  • [2] Trace Anomaly Detection for Microservice Systems via Graph-based Semi-supervised Learning
    Ding, Shuai
    Yuepeng, E.
    Zhang, Jiye
    Li, Liangxiong
    Zhang, Lei
    Ge, Jingguo
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2375 - 2380
  • [3] A Survey of Graph-Based Deep Learning for Anomaly Detection in Distributed Systems
    Pazho, Armin Danesh
    Noghre, Ghazal Alinezhad
    Purkayastha, Arnab A.
    Vempati, Jagannadh
    Martin, Otto
    Tabkhi, Hamed
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (01) : 1 - 20
  • [4] TraceGra: A trace-based anomaly detection for microservice using graph deep learning
    Chen, Jian
    Liu, Fagui
    Jiang, Jun
    Zhong, Guoxiang
    Xu, Dishi
    Tan, Zhuanglun
    Shi, Shangsong
    COMPUTER COMMUNICATIONS, 2023, 204 : 109 - 117
  • [5] LogGC: Novel Approach for Graph-based Log Anomaly Detection
    Andonov, Stefan
    Madjarov, Gjorgji
    2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 1194 - 1202
  • [6] Unsupervised Microservice Log Anomaly Detection Method Based on Graph Neural Network
    Liang, Xue
    Li, Lixiang
    Peng, Haipeng
    ADVANCES IN SWARM INTELLIGENCE, PT II, ICSI 2024, 2024, 14789 : 197 - 208
  • [7] Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
    Huang, Jun
    Yang, Yang
    Yu, Hang
    Li, Jianguo
    Zheng, Xiao
    2023 38TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, ASE, 2023, : 66 - 78
  • [8] A Method of Microservice Performance Anomaly Detection Based on Deep Learning
    Fang H.
    Li C.
    Wang Q.
    Zhou K.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (03): : 600 - 613
  • [9] Learning Region Similarities via Graph-Based Deep Metric Learning
    Zhao, Yunxiang
    Qi, Jianzhong
    Trisedya, Bayu D.
    Su, Yixin
    Zhang, Rui
    Ren, Hongguang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10237 - 10250
  • [10] Root-Cause Metric Location for Microservice Systems via Log Anomaly Detection
    Wang, Lingzhi
    Zhao, Nengwen
    Chen, Junjie
    Li, Pinnong
    Zhang, Wenchi
    Sui, Kaixin
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2020), 2020, : 142 - 150