Skip-patching spatial-temporal discrepancy-based anomaly detection on multivariate time series

被引:1
|
作者
Xu, Yinsong [1 ,2 ,3 ]
Ding, Yulong [1 ,3 ]
Jiang, Jie [4 ]
Cong, Runmin [5 ,6 ]
Zhang, Xuefeng [9 ]
Wang, Shiqi [2 ]
Kwong, Sam [7 ]
Yang, Shuang-Hua [3 ,8 ]
机构
[1] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Guangdong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Southern Univ Sci & Technol, Shenzhen Key Lab Safety & Secur Next Generat Ind I, Shenzhen, Guangdong, Peoples R China
[4] China Univ Petr, Coll Artificial Intelligence, Beijing, Peoples R China
[5] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[6] Minist Educ, Key Lab Machine Intelligence & Syst Control, Jinan, Peoples R China
[7] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
[8] Univ Reading, Dept Comp Sci, Reading RG6 6AH, England
[9] Northeastern Univ, Coll Sci, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Industrial Internet of Things; Self-supervised learning; Multivariate time series; INTRUSION DETECTION;
D O I
10.1016/j.neucom.2024.128428
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection in the Industrial Internet of Things (IIoT) is a challenging task that relies heavily on the efficient learning of multivariate time series representations. We introduce Skip-patching and Spatial- Temporal discrepancy mechanisms to improve the efficiency of detecting anomalies. Traditional feature extraction is hindered by redundant information in limited datasets. The situation is that feature generation from stable operational processes results in low-quality representations. To address this challenge, we propose the Skip-Patching mechanism. This approach involves selectively extracting features from partial data patches, prompting the model to learn more meaningful knowledge through self-supervised learning. It also effectively doubles the training sample size by creating independent sub-groups of patches. Despite the complex spatial and temporal relationships in IIoT systems, existing methods mainly extracted features from a single domain, either temporal or spatial (sensor-wise), or simply cascaded two features, i.e., one after one, which limited anomaly detection capabilities. To address this, we introduce the Spatial-Temporal Association Discrepancy component, which leverages discrepancies between spatial and temporal features to enhance latent representation learning. Our Skip-Patching Spatial-Temporal Anomaly Detection (SSAD) framework combines these two components to provide a more diverse and comprehensive learning process. Tested across four multivariate time series anomaly detection benchmarks, SSAD demonstrates superior performance, confirming the efficacy of combining Skip-patching and Spatial-Temporal features to enhance anomaly detection in IIoT systems.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] GTAD: Graph and Temporal Neural Network for Multivariate Time Series Anomaly Detection
    Guan, Siwei
    Zhao, Binjie
    Dong, Zhekang
    Gao, Mingyu
    He, Zhiwei
    ENTROPY, 2022, 24 (06)
  • [32] Exploiting Spatial-temporal Correlations for Video Anomaly Detection
    Zhao, Mengyang
    Liu, Yang
    Liu, Jing
    Zeng, Xinhua
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1727 - 1733
  • [33] Multiscale spatial-temporal transformer with consistency representation learning for multivariate time series classification
    Wu, Wei
    Qiu, Feiyue
    Wang, Liping
    Liu, Yanxiu
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (27):
  • [34] Anomaly Detection in Multivariate Spatial Time Series: A Ready-to-Use Implementation
    Bachechi, Chiara
    Rollo, Federica
    Po, Laura
    Quattrini, Fabio
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON WEB INFORMATION SYSTEMS AND TECHNOLOGIES (WEBIST), 2021, : 509 - 517
  • [35] Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecasting
    Shao, Zezhi
    Zhang, Zhao
    Wang, Fei
    Wei, Wei
    Xu, Yongjun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4454 - 4458
  • [36] Fully-Connected Spatial-Temporal Graph for Multivariate Time-Series Data
    Wang, Yucheng
    Xu, Yuecong
    Yang, Jianfei
    Wu, Min
    Li, Xiaoli
    Xie, Lihua
    Chen, Zhenghua
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 14, 2024, : 15715 - 15724
  • [37] Generative Anomaly Detection in Multivariate Time Series
    Hoh, M.
    Schöttl, A.
    Schaub, H.
    Leuze, N.
    Automation, Robotics and Communications for Industry 4.0/5.0, 2023, 2023 : 171 - 174
  • [38] TPAD: Temporal-Pattern-Based Neural Network Model for Anomaly Detection in Multivariate Time Series
    Ma, Shenhui
    Guan, Siwei
    He, Zhiwei
    Nie, Jiahao
    Gao, Mingyu
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30668 - 30682
  • [39] Robust anomaly detection for multivariate time series through temporal GCNs and attention-based VAE
    Shi, Yunfei
    Wang, Bin
    Yu, Yanwei
    Tang, Xianfeng
    Huang, Chao
    Dong, Junyu
    KNOWLEDGE-BASED SYSTEMS, 2023, 275
  • [40] Discrepancy-Based Theory and Algorithms for Forecasting Non-Stationary Time Series
    Vitaly Kuznetsov
    Mehryar Mohri
    Annals of Mathematics and Artificial Intelligence, 2020, 88 : 367 - 399