LMGD: Log-Metric Combined Microservice Anomaly Detection Through Graph-Based Deep Learning

被引:0
|
作者
Liu, Xu [1 ]
Liu, Yuewen [2 ]
Wei, Miaomiao [2 ]
Xu, Peng [2 ]
机构
[1] China Acad Ind Internet, Beijing 100083, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Microservice architectures; Anomaly detection; Measurement; Long short term memory; Logic gates; Monitoring; Data models; Real-time systems; Vectors; Predictive models; log; metrics; distributed systems; GCN; GAT;
D O I
10.1109/ACCESS.2024.3481676
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Microservice architecture is a high-cohesion and low-coupling software architecture. Its core idea is to split the application into a set of microservices with a single function and independent deployment. Due to their complexity and large scale, microservice systems are typically fragile and failures are inevitable. Therefore, there is an urgent need for fast and accurate anomaly detection capabilities. However, the existing microservice anomaly detection methods do not pay attention to the multi-source data of the microservice system and thus have low accuracy. To address this limitation, we propose a Log-Metric Combined Microservice Anomaly Detection approach through Graph-based Deep Learning (termed as LMGD). First, we propose a time-aware LSTM prediction neural network to improve the accuracy of service dependency mining. Secondly, based on the service dependency graph, we propose an anomaly detection method based on log-metric fusion, which can more accurately describe the running status of microservices, thereby improving the accuracy of anomaly detection. The experimental outcomes demonstrate that compared with other state-of-the-art methods, our method improves recall and F1-score by 2.63% and 1.05%.
引用
收藏
页码:186510 / 186519
页数:10
相关论文
共 50 条
  • [41] Deep graph level anomaly detection with contrastive learning
    Luo, Xuexiong
    Wu, Jia
    Yang, Jian
    Xue, Shan
    Peng, Hao
    Zhou, Chuan
    Chen, Hongyang
    Li, Zhao
    Sheng, Quan Z.
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [42] A Comprehensive Survey on Graph Anomaly Detection With Deep Learning
    Ma, Xiaoxiao
    Wu, Jia
    Xue, Shan
    Yang, Jian
    Zhou, Chuan
    Sheng, Quan Z.
    Xiong, Hui
    Akoglu, Leman
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12012 - 12038
  • [43] Deep graph level anomaly detection with contrastive learning
    Xuexiong Luo
    Jia Wu
    Jian Yang
    Shan Xue
    Hao Peng
    Chuan Zhou
    Hongyang Chen
    Zhao Li
    Quan Z. Sheng
    Scientific Reports, 12
  • [44] Graph-based multimodal fusion with metric learning for multimodal classification
    Angelou, Michalis
    Solachidis, Vassilis
    Vretos, Nicholas
    Daras, Petros
    PATTERN RECOGNITION, 2019, 95 : 296 - 307
  • [45] Action Sequence Augmentation for Early Graph-based Anomaly Detection
    Zhao, Tong
    Ni, Bo
    Yu, Wenhao
    Guo, Zhichun
    Shah, Neil
    Jiang, Meng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2668 - 2678
  • [46] BinarizedAttack: Structural Poisoning Attacks to Graph-based Anomaly Detection
    Zhu, Yulin
    Lai, Yuni
    Zhao, Kaifa
    Luo, Xiapu
    Yuan, Mingquan
    Ren, Jian
    Zhou, Kai
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 14 - 26
  • [47] GRAPH-BASED IDENTIFICATION OF BOUNDARY POINTS FOR UNMIXING AND ANOMALY DETECTION
    Rohani, Neda
    Parente, Mario
    2013 5TH WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS), 2013,
  • [48] Parallel graph-based anomaly detection technique for sequential data
    Farag, Ahmed
    Abdelkader, Hatem
    Salem, Rashed
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (01) : 1446 - 1454
  • [49] A knowledge graph-based structured representation of assembly process planning combined with deep learning
    Shi, Xiaolin
    Tian, Xitian
    Ma, Liping
    Wu, Xv
    Gu, Jianguo
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 133 (3-4): : 1807 - 1821
  • [50] A new distributed anomaly detection approach for log IDS management based on deep learning
    Koca, Murat
    Aydin, Muhammed Ali
    Sertbas, Ahmet
    Zaim, Abdul Halim
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2021, 29 (05) : 2486 - 2501