Anomaly Detection in Dynamic Graphs via Transformer

被引:9
|
作者
Liu, Yixin [1 ]
Pan, Shirui [1 ]
Wang, Yu Guang [2 ,3 ]
Xiong, Fei [4 ]
Wang, Liang [5 ]
Chen, Qingfeng [6 ]
Lee, Vincent C. S. [1 ]
机构
[1] Monash Univ, Fac IT, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Shanghai Jiao Tong Univ, Inst Nat Sci, Sch Math Sci, Shanghai 200240, Peoples R China
[3] Max Planck Inst Math Sci, Math Machine Learning Grp, D-04103 Leipzig, Germany
[4] Beijing Jiaotong Univ, Lab Commun & Informat Syst, Beijing Municipal Commiss Educ, Beijing 100044, Peoples R China
[5] Northwestern Polytech Univ, Sch Comp Sci, Xian, Shaanxi, Peoples R China
[6] Guangxi Univ, Sch Comp Elect & Informat, Nanning 530004, Peoples R China
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Anomaly detection; dynamic graphs; transformer;
D O I
10.1109/TKDE.2021.3124061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting anomalies for dynamic graphs has drawn increasing attention due to their wide applications in social networks, e-commerce, and cybersecurity. Recent deep learning-based approaches have shown promising results over shallow methods. However, they fail to address two core challenges of anomaly detection in dynamic graphs: the lack of informative encoding for unattributed nodes and the difficulty of learning discriminate knowledge from coupled spatial-temporal dynamic graphs. To overcome these challenges, in this paper, we present a novel <bold>T</bold>ransformer-based <bold>A</bold>nomaly <bold>D</bold>etection framework for <bold>DY</bold>namic graphs (<bold>TADDY</bold>). Our framework constructs a comprehensive node encoding strategy to better represent each node's structural and temporal roles in an evolving graphs stream. Meanwhile, TADDY captures informative representation from dynamic graphs with coupled spatial-temporal patterns via a dynamic graph transformer model. The extensive experimental results demonstrate that our proposed TADDY framework outperforms the state-of-the-art methods by a large margin on six real-world datasets.
引用
收藏
页码:12081 / 12094
页数:14
相关论文
共 50 条
  • [41] Nonparametric Anomaly Detection on Time Series of Graphs
    Ofori-Boateng, Dorcas
    Gel, Yulia R.
    Cribben, Ivor
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (03) : 756 - 767
  • [42] Anomaly Detection in Car-Booking Graphs
    Shchur, Oleksandr
    Bojchevski, Aleksandar
    Farghal, Mohamed
    Guennemann, Stephan
    Saber, Yusuf
    2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 604 - 607
  • [43] Coding of Graphs with Application to Graph Anomaly Detection
    Host-Madsen, Anders
    Zhang, June
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 1829 - 1833
  • [44] Neighborhood formation and anomaly detection in bipartite graphs
    Sun, JM
    Qu, HM
    Chakrabarti, D
    Faloutsos, C
    FIFTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2005, : 418 - 425
  • [45] RustGraph: Robust Anomaly Detection in Dynamic Graphs by Jointly Learning Structural-Temporal Dependency
    Guo, Jianhao
    Tang, Siliang
    Li, Juncheng
    Pan, Kaihang
    Wu, Lingfei
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (07) : 3472 - 3485
  • [46] Adaptive DecayRank: Real-Time Anomaly Detection in Dynamic Graphs with Bayesian PageRank Updates
    Ekle, Ocheme Anthony
    Eberle, William
    Christopher, Jared
    APPLIED SCIENCES-BASEL, 2025, 15 (06):
  • [47] Research of anomaly detection based on dynamic anomaly detection enhancement framework
    Zhu, Xiaoxun
    Weng, Songwei
    Wang, Yu
    Yang, Zhen
    Cao, Jingyuan
    Gao, Xiaoxia
    Dong, Lijiang
    Lin, Xiang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [48] Improving the Accuracy of Anomaly Detection from System Audit Logs via Heterogeneous Provenance Graphs
    Wu, Qiangyi
    Xiang, Yiyu
    2024 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS, NANA 2024, 2024, : 529 - 535
  • [49] Logformer: Cascaded Transformer for System Log Anomaly Detection
    Hang, Feilu
    Guo, Wei
    Chen, Hexiong
    Xie, Linjiang
    Zhou, Chenghao
    Liu, Yao
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 136 (01): : 517 - 529
  • [50] UTRAD: Anomaly detection and localization with U-Transformer
    Chen, Liyang
    You, Zhiyuan
    Zhang, Nian
    Xi, Juntong
    Le, Xinyi
    NEURAL NETWORKS, 2022, 147 : 53 - 62