GTformer: Graph-Based Temporal-Order-Aware Transformer for Long-Term Series Forecasting

被引:2
|
作者
Liang, Aobo [1 ]
Chai, Xiaolin [1 ]
Sun, Yan [1 ]
Guizani, Mohsen [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[2] Mohamed Bin Zayed Univ Artificial Intelligence, Machine Learning Dept, Abu Dhabi, U Arab Emirates
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 19期
基金
中国国家自然科学基金;
关键词
Time series analysis; Transformers; Predictive models; Forecasting; Data models; Task analysis; Internet of Things; Interseries dependencies; long-term time series forecasting; multivariate time series (MTS); strict temporal order; transformer; INTERNET; NETWORK;
D O I
10.1109/JIOT.2024.3419768
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the production environment of the Internet of Things (IoT), sensors of various qualities generate a large amount of multivariate time series (MTS) data. The long-term prediction of time series data generated by various IoT devices provides longer foresight and helps execute necessary resource scheduling or fault alarms in advance, thus improving the efficiency of system operation and ensuring system security. In recent years, deep learning models like Transformers have achieved advanced performance in multivariate long-term time series forecasting (MLTSF) tasks. However, many previous research attempts either overlooked the interseries dependencies or ignored the need to model the strict temporal order of MTS data. In this article, we introduce GTformer, a graph-based temporal-order-aware transformer model. We propose an adaptive graph learning method specifically designed for MTS data to capture both uni-directional and bi-directional relations. In addition, we generate positional encoding in a sequential way to emphasize the strict temporal order of time series. By adopting these two components, our model can have a better understanding of the interseries and intraseries dependencies of MTS data. We conducted extensive experiments on eight real-world data sets, and the results show that our model achieves better predictions compared with state-of-the-art methods.
引用
收藏
页码:31467 / 31478
页数:12
相关论文
共 50 条
  • [1] GATFormer: A Graph-based Transformer for Long-Term Forecasting of Traffic Overcrowding
    Zhang, Ke
    Liu, Hengchang
    Clarke, Siobhan
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 1629 - 1635
  • [2] Long-term forecasting using transformer based on multiple time series
    Lee, Jaeyong
    Kim, Hyun Jun
    Lim, Changwon
    KOREAN JOURNAL OF APPLIED STATISTICS, 2024, 37 (05) : 583 - 598
  • [3] A systematic review for transformer-based long-term series forecasting
    Su, Liyilei
    Zuo, Xumin
    Li, Rui
    Wang, Xin
    Zhao, Heng
    Huang, Bingding
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (03)
  • [4] Physically-guided temporal diffusion transformer for long-term time series forecasting
    Ren, Zeqi
    Yu, Jianbo
    Huang, Jian
    Yang, Xiaofeng
    Leng, Siyang
    Liu, Yuping
    Yan, Shifu
    KNOWLEDGE-BASED SYSTEMS, 2024, 304
  • [5] PWDformer: Deformable transformer for long-term series forecasting
    Wang, Zheng
    Ran, Haowei
    Ren, Jinchang
    Sun, Meijun
    PATTERN RECOGNITION, 2024, 147
  • [6] Spatial-Temporal Graph-Based Transformer Model for Traffic Flow Forecasting
    Wang, Qichao
    He, Guojun
    Lu, Peiyu
    Chen, Qiyang
    Chen, Yanrong
    Huang, Wei
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2806 - 2811
  • [7] Segformer: Segment-Based Transformer with Decomposition for Long-Term Series Forecasting
    Chen, Jinhua
    Fan, Jin
    Liu, Zhen
    Xiang, Jiaqian
    Wu, Jia
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [8] BSTG-Trans: A Bayesian Spatial-Temporal Graph Transformer for Long-Term Pose Forecasting
    Mo, Shentong
    Xin, Miao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 673 - 686
  • [9] Constructing Geographic and Long-term Temporal Graph for Traffic Forecasting
    Sun, Yiwen
    Wang, Yulu
    Fu, Kun
    Wang, Zheng
    Zhang, Changshui
    Ye, Jieping
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3483 - 3490
  • [10] Graph-based High-order Relation Modeling for Long-term Action Recognition
    Zhou, Jiaming
    Lin, Kun-Yu
    Li, Haoxin
    Zheng, Wei-Shi
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8980 - 8989