Anomaly Detection in Dynamic Graphs via Transformer

被引:9
|
作者
Liu, Yixin [1 ]
Pan, Shirui [1 ]
Wang, Yu Guang [2 ,3 ]
Xiong, Fei [4 ]
Wang, Liang [5 ]
Chen, Qingfeng [6 ]
Lee, Vincent C. S. [1 ]
机构
[1] Monash Univ, Fac IT, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Shanghai Jiao Tong Univ, Inst Nat Sci, Sch Math Sci, Shanghai 200240, Peoples R China
[3] Max Planck Inst Math Sci, Math Machine Learning Grp, D-04103 Leipzig, Germany
[4] Beijing Jiaotong Univ, Lab Commun & Informat Syst, Beijing Municipal Commiss Educ, Beijing 100044, Peoples R China
[5] Northwestern Polytech Univ, Sch Comp Sci, Xian, Shaanxi, Peoples R China
[6] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Peoples R China
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Anomaly detection; dynamic graphs; transformer;
D O I
10.1109/TKDE.2021.3124061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting anomalies for dynamic graphs has drawn increasing attention due to their wide applications in social networks, e-commerce, and cybersecurity. Recent deep learning-based approaches have shown promising results over shallow methods. However, they fail to address two core challenges of anomaly detection in dynamic graphs: the lack of informative encoding for unattributed nodes and the difficulty of learning discriminate knowledge from coupled spatial-temporal dynamic graphs. To overcome these challenges, in this paper, we present a novel <bold>T</bold>ransformer-based <bold>A</bold>nomaly <bold>D</bold>etection framework for <bold>DY</bold>namic graphs (<bold>TADDY</bold>). Our framework constructs a comprehensive node encoding strategy to better represent each node's structural and temporal roles in an evolving graphs stream. Meanwhile, TADDY captures informative representation from dynamic graphs with coupled spatial-temporal patterns via a dynamic graph transformer model. The extensive experimental results demonstrate that our proposed TADDY framework outperforms the state-of-the-art methods by a large margin on six real-world datasets.
引用
收藏
页码:12081 / 12094
页数:14
相关论文
共 50 条
  • [1] Attribute encoding transformer on unattributed dynamic graphs for anomaly detection
    Wang, Shang
    Hao, Haihong
    Gao, Yuan
    Wang, Xiang
    He, Xiangnan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025,
  • [2] Anomaly Detection in Directed Dynamic Graphs via RDGCN and LSTAN
    Li, Mark Junjie
    Gao, Zukang
    Li, Jun
    Bao, Xianyu
    Li, Meiting
    Zhao, Gen
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 1 - 12
  • [3] Anomaly Detection in Dynamic Graphs: A Comprehensive Survey
    Ekle, Ocheme Anthony
    Eberle, William
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (08)
  • [4] DGRMiner: Anomaly Detection and Explanation in Dynamic Graphs
    Vaculik, Karel
    Popelinsky, Lubos
    ADVANCES IN INTELLIGENT DATA ANALYSIS XV, 2016, 9897 : 308 - 319
  • [5] Motif-Level Anomaly Detection in Dynamic Graphs
    Yuan, Zirui
    Shao, Minglai
    Yan, Qiben
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 2870 - 2882
  • [6] SAD: Semi-Supervised Anomaly Detection on Dynamic Graphs
    Tian, Sheng
    Dong, Jihai
    Li, Jintang
    Zhao, Wenlong
    Xu, Xiaolong
    Wang, Baokun
    Song, Bowen
    Meng, Changhua
    Zhang, Tianyi
    Chen, Liang
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2306 - 2314
  • [7] Inpainting Transformer for Anomaly Detection
    Pirnay, Jonathan
    Chai, Keng
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT II, 2022, 13232 : 394 - 406
  • [8] Concept Drift Adaptation for Time Series Anomaly Detection via Transformer
    Ding, Chaoyue
    Zhao, Jing
    Sun, Shiliang
    NEURAL PROCESSING LETTERS, 2023, 55 (03) : 2081 - 2101
  • [9] Concept Drift Adaptation for Time Series Anomaly Detection via Transformer
    Chaoyue Ding
    Jing Zhao
    Shiliang Sun
    Neural Processing Letters, 2023, 55 : 2081 - 2101
  • [10] Structural Temporal Graph Neural Networks for Anomaly Detection in Dynamic Graphs
    Cai, Lei
    Chen, Zhengzhang
    Luo, Chen
    Gui, Jiaping
    Ni, Jingchao
    Li, Ding
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3747 - 3756