Anomaly Detection for Cloud Systems with Dynamic Spatiotemporal Learning

被引:1
|
作者
Yu, Mingguang [1 ,2 ]
Zhang, Xia [1 ,2 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[2] Neusoft Corp, Shenyang 110179, Peoples R China
来源
关键词
System maintenance; anomaly detection; GCN; LSTM; AIOps;
D O I
10.32604/iasc.2023.038798
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As cloud system architectures evolve continuously, the interac-tions among distributed components in various roles become increasingly complex. This complexity makes it difficult to detect anomalies in cloud systems. The system status can no longer be determined through individual key performance indicators (KPIs) but through joint judgments based on syn-ergistic relationships among distributed components. Furthermore, anomalies in modern cloud systems are usually not sudden crashes but rather grad-ual, chronic, localized failures or quality degradations in a weakly available state. Therefore, accurately modeling cloud systems and mining the hidden system state is crucial. To address this challenge, we propose an anomaly detection method with dynamic spatiotemporal learning (AD-DSTL). AD-DSTL leverages the spatiotemporal dynamics of the system to train an end -to-end deep learning model driven by data from system monitoring to detect underlying anomalous states in complex cloud systems. Unlike previous work that focuses on the KPIs of separate components, AD-DSTL builds a model for the entire system and characterizes its spatiotemporal dynamics based on graph convolutional networks (GCN) and long short-term memory (LSTM). We validated AD-DSTL using four datasets from different backgrounds, and it demonstrated superior robustness compared to other baseline algorithms. Moreover, when raising the target exception level, both the recall and precision of AD-DSTL reached approximately 0.9. Our experimental results demon-strate that AD-DSTL can meet the requirements of anomaly detection for complex cloud systems.
引用
收藏
页码:1787 / 1806
页数:20
相关论文
共 50 条
  • [21] A Cloud Server Anomaly Detection Model Based on Time Series Decomposition and Spatiotemporal Information Extraction
    Tang L.
    Zhao Y.
    Xue C.
    Chen Q.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (06): : 2638 - 2646
  • [22] Anomaly Detection in Cloud Components
    Islam, Mohammad Saiful
    Miranskyy, Andriy
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2020), 2020, : 1 - 3
  • [23] Prototype augmentation-based spatiotemporal anomaly detection in smart mobility systems
    Zhou, Zhen
    Gu, Ziyuan
    Jiang, Anfeng
    Liu, Zhiyuan
    Zhao, Yi
    Liu, Hongzhe
    TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2025, 193
  • [24] Using Deep Learning for Anomaly Detection in Autonomous Systems
    Jha, Nikhil Kumar
    von Enzberg, Sebastian
    Hillebrand, Michael
    ERCIM NEWS, 2020, (122): : 47 - 48
  • [25] BACS: A comprehensive tool for deep learning-based anomaly detection in edge-fog-cloud systems
    Milosevic, N.
    Jakovetic, D.
    Skrbic, S.
    Savic, M.
    Stamenkovic, D.
    Mascolo, J.
    Masera, D.
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 1097 - 1101
  • [26] Anomaly Detection for IOT Systems Using Active Learning
    Zakariah, Mohammed
    Almazyad, Abdulaziz S.
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [27] Instantaneous anomaly detection in online learning fuzzy systems
    Brockmann, Werner
    Rosemann, Nils
    2008 3RD INTERNATIONAL WORKSHOP ON GENETIC AND EVOLVING FUZZY SYSTEMS, 2008, : 21 - 26
  • [28] Anomaly Detection for Soft Security in Cloud based Auditing of Accounting Systems
    Neovius, Mats
    Duncan, Bob
    CLOSER: PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, 2017, : 471 - 478
  • [29] Cross-dataset Time Series Anomaly Detection for Cloud Systems
    Zhang, Xu
    Lin, Qingwei
    Xu, Yong
    Qin, Si
    Zhang, Hongyu
    Qiao, Bo
    Dang, Yingnong
    Yang, Xinsheng
    Cheng, Qian
    Chintalapati, Murali
    Wu, Youjiang
    Hsieh, Ken
    Sui, Kaixin
    Meng, Xin
    Xu, Yaohai
    Zhang, Wenchi
    Shen, Furao
    Zhang, Dongmei
    PROCEEDINGS OF THE 2019 USENIX ANNUAL TECHNICAL CONFERENCE, 2019, : 1063 - 1076
  • [30] Time Series Anomaly Detection for Trustworthy Services in Cloud Computing Systems
    Huang, Chengqiang
    Min, Geyong
    Wu, Yulei
    Ying, Yiming
    Pei, Ke
    Xiang, Zuochang
    IEEE TRANSACTIONS ON BIG DATA, 2022, 8 (01) : 60 - 72