LMGD: Log-Metric Combined Microservice Anomaly Detection Through Graph-Based Deep Learning

被引:0
|
作者
Liu, Xu [1 ]
Liu, Yuewen [2 ]
Wei, Miaomiao [2 ]
Xu, Peng [2 ]
机构
[1] China Acad Ind Internet, Beijing 100083, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Microservice architectures; Anomaly detection; Measurement; Long short term memory; Logic gates; Monitoring; Data models; Real-time systems; Vectors; Predictive models; log; metrics; distributed systems; GCN; GAT;
D O I
10.1109/ACCESS.2024.3481676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a high-cohesion and low-coupling software architecture. Its core idea is to split the application into a set of microservices with a single function and independent deployment. Due to their complexity and large scale, microservice systems are typically fragile and failures are inevitable. Therefore, there is an urgent need for fast and accurate anomaly detection capabilities. However, the existing microservice anomaly detection methods do not pay attention to the multi-source data of the microservice system and thus have low accuracy. To address this limitation, we propose a Log-Metric Combined Microservice Anomaly Detection approach through Graph-based Deep Learning (termed as LMGD). First, we propose a time-aware LSTM prediction neural network to improve the accuracy of service dependency mining. Secondly, based on the service dependency graph, we propose an anomaly detection method based on log-metric fusion, which can more accurately describe the running status of microservices, thereby improving the accuracy of anomaly detection. The experimental outcomes demonstrate that compared with other state-of-the-art methods, our method improves recall and F1-score by 2.63% and 1.05%.
引用
收藏
页码:186510 / 186519
页数:10
相关论文
共 50 条
  • [21] Deep learning for anomaly detection in log data: A survey
    Landauer, Max
    Onder, Sebastian
    Skopik, Florian
    Wurzenberger, Markus
    MACHINE LEARNING WITH APPLICATIONS, 2023, 12
  • [22] Deep learning for anomaly detection in log data: A survey
    Landauer, Max
    Onder, Sebastian
    Skopik, Florian
    Wurzenberger, Markus
    Machine Learning with Applications, 2023, 12
  • [23] Enhancing Log Anomaly Detection through Knowledge Graph Integration
    Chen, Guan-Fu
    Yang, Tai-Ju
    Chen, Chien Chin
    18TH IEEE INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING, ICSC 2024, 2024, : 204 - 207
  • [24] Discrete log anomaly detection: A novel time-aware graph-based link prediction approach
    Yan, Lejing
    Luo, Chao
    Shao, Rui
    INFORMATION SCIENCES, 2023, 647
  • [25] Dynamic Graph-Based Anomaly Detection in the Electrical Grid
    Li, Shimiao
    Pandey, Amritanshu
    Hooi, Bryan
    Faloutsos, Christos
    Pileggi, Larry
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (05) : 3408 - 3422
  • [26] A Graph-based Clustering Algorithm for Anomaly Intrusion Detection
    Zhou Mingqiang
    Huang Hui
    Wang Qian
    PROCEEDINGS OF 2012 7TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, VOLS I-VI, 2012, : 1311 - 1314
  • [27] Evolving graph-based video crowd anomaly detection
    Yang, Meng
    Feng, Yanghe
    Rao, Aravinda S.
    Rajasegarar, Sutharshan
    Tian, Shucong
    Zhou, Zhengchun
    VISUAL COMPUTER, 2024, 40 (01): : 303 - 318
  • [28] Graph-Based Anomaly Detection via Attention Mechanism
    Yu, Yangming
    Zha, Zhiyong
    Jin, Bo
    Wu, Geng
    Dong, Chenxi
    INTELLIGENT COMPUTING THEORIES AND APPLICATION (ICIC 2022), PT I, 2022, 13393 : 401 - 411
  • [29] Graph-based Anomaly Detection for Smart Cities: A Survey
    Sudrich, Simon
    Borges, Julio
    Beigl, Michael
    2017 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTED, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2017,
  • [30] Dynamic Graph-Based Anomaly Detection in the Electrical Grid
    Li, Shimiao
    Pandey, Amritanshu
    Hooi, Bryan
    Faloutsos, Christos
    Pileggi, Larry
    2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,