Anomaly Detection for Cloud Systems with Dynamic Spatiotemporal Learning

被引:1
|
作者
Yu, Mingguang [1 ,2 ]
Zhang, Xia [1 ,2 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[2] Neusoft Corp, Shenyang 110179, Peoples R China
来源
关键词
System maintenance; anomaly detection; GCN; LSTM; AIOps;
D O I
10.32604/iasc.2023.038798
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As cloud system architectures evolve continuously, the interac-tions among distributed components in various roles become increasingly complex. This complexity makes it difficult to detect anomalies in cloud systems. The system status can no longer be determined through individual key performance indicators (KPIs) but through joint judgments based on syn-ergistic relationships among distributed components. Furthermore, anomalies in modern cloud systems are usually not sudden crashes but rather grad-ual, chronic, localized failures or quality degradations in a weakly available state. Therefore, accurately modeling cloud systems and mining the hidden system state is crucial. To address this challenge, we propose an anomaly detection method with dynamic spatiotemporal learning (AD-DSTL). AD-DSTL leverages the spatiotemporal dynamics of the system to train an end -to-end deep learning model driven by data from system monitoring to detect underlying anomalous states in complex cloud systems. Unlike previous work that focuses on the KPIs of separate components, AD-DSTL builds a model for the entire system and characterizes its spatiotemporal dynamics based on graph convolutional networks (GCN) and long short-term memory (LSTM). We validated AD-DSTL using four datasets from different backgrounds, and it demonstrated superior robustness compared to other baseline algorithms. Moreover, when raising the target exception level, both the recall and precision of AD-DSTL reached approximately 0.9. Our experimental results demon-strate that AD-DSTL can meet the requirements of anomaly detection for complex cloud systems.
引用
收藏
页码:1787 / 1806
页数:20
相关论文
共 50 条
  • [31] Performance Metric Selection for Autonomic Anomaly Detection on Cloud Computing Systems
    Fu, Song
    2011 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE (GLOBECOM 2011), 2011,
  • [32] iGroup Learning and iDetect for Dynamic Anomaly Detection with Applications in Maritime Threat Detection
    Cai, Chencheng
    Chen, Rong
    Liu, Alexander D.
    Roberts, Fred S.
    Xie, Minge
    PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE), 2018, : 329 - 334
  • [33] Spatiotemporal Anomaly Detection Using Deep Learning for Real-Time Video Surveillance
    Nawaratne, Rashmika
    Alahakoon, Damminda
    De Silva, Daswin
    Yu, Xinghuo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (01) : 393 - 402
  • [34] Machine Learning vs Deep Learning for Anomaly Detection and Categorization in Multi-cloud Environments
    Akoto, John
    Salman, Tara
    2022 IEEE CLOUD SUMMIT, 2022, : 44 - 50
  • [35] Cloud-based multiclass anomaly detection and categorization using ensemble learning
    Faisal Shahzad
    Abdul Mannan
    Abdul Rehman Javed
    Ahmad S. Almadhor
    Thar Baker
    Dhiya Al-Jumeily OBE
    Journal of Cloud Computing, 11
  • [36] Assessing Unsupervised Machine Learning solutions for Anomaly Detection in Cloud Gaming Sessions
    Ky, Joel Roman
    Mathieu, Bertrand
    Lahmadi, Abdelkader
    Boutaba, Raouf
    2022 18TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM 2022): INTELLIGENT MANAGEMENT OF DISRUPTIVE NETWORK TECHNOLOGIES AND SERVICES, 2022,
  • [37] Cloud-based multiclass anomaly detection and categorization using ensemble learning
    Shahzad, Faisal
    Mannan, Abdul
    Javed, Abdul Rehman
    Almadhor, Ahmad S.
    Baker, Thar
    Obe, Dhiya Al-Jumeily
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2022, 11 (01):
  • [38] Anomaly Detection using Convolutional Spatiotemporal Autoencoder
    Dhole, Hemant
    Sutaone, Mukul
    Vyas, Vibha
    2019 10TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2019,
  • [39] Spatiotemporal Deformable Prototypes for Motion Anomaly Detection
    Bensch, Robert
    Scherf, Nico
    Huisken, Jan
    Brox, Thomas
    Ronneberger, Olaf
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 122 (03) : 502 - 523
  • [40] Spatiotemporal Deformable Prototypes for Motion Anomaly Detection
    Robert Bensch
    Nico Scherf
    Jan Huisken
    Thomas Brox
    Olaf Ronneberger
    International Journal of Computer Vision, 2017, 122 : 502 - 523