FAITH: Frequency-domain Attention In Two Horizons for time series forecasting

被引:0
|
作者
Li, Ruiqi [1 ,2 ,3 ]
Jiang, Maowei [1 ,2 ,3 ]
Liu, Quangao [1 ,2 ,3 ]
Wang, Kai [1 ,2 ]
Feng, Kaiduo [1 ,2 ,3 ]
Sun, Yue [4 ]
Zhou, Xiufang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shenyang Univ Technol, Sch Informat Sci & Engn, Shenyang 110870, Peoples R China
关键词
Time series forecasting; Frequency domain; Channel; Attention mechanism; Real world datasets;
D O I
10.1016/j.knosys.2024.112790
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time Series Forecasting (TSF) plays a crucial role in various sectors, including industrial maintenance, weather prediction, energy management, traffic control, and financial planning. Current deep learning-based predictive models often exhibit significant deviations between their forecasting outcomes and the ground truth because they lack an efficient method to extract both the global frequency-domain information of each variable and the relationships between different variables. To tackle this challenge, we introduce an innovative model- Frequency-domain Attention In Two Horizons (FAITH). FAITH decomposes time series into trend and seasonal components using a multi-scale adaptive decomposition and fusion architecture and processes them separately. It utilizes two modules - the Frequency Channel Feature Extraction Module (FCEM) and the Frequency Temporal Feature Extraction Module (FTEM) - to capture inter-channel relationships at a finer granularity and to extract global temporal information from the frequency domain of different variables. This significantly enhances its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time-frequency domain transformation method, effectively reducing computational costs. Extensive experiments across six benchmarks for long-term forecasting and five benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in various domains, such as electricity, weather, and traffic. These results validate the effectiveness and superiority of FAITH in both long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH
引用
收藏
页数:12
相关论文
共 50 条
  • [31] FAMC-Net: Frequency Domain Parity Correction Attention and Multi-Scale Dilated Convolution for Time Series Forecasting
    Wang, Min
    Wang, Hua
    Zhang, Fan
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 2554 - 2563
  • [32] Frequency-domain analysis of the static synchronous series compensator
    Pradhan, AC
    Lehn, PW
    IEEE TRANSACTIONS ON POWER DELIVERY, 2006, 21 (01) : 440 - 449
  • [33] Research On Frequency-Domain Kernel Identification Of Volterra Series
    Wu, Shihao
    Meng, Yafeng
    Wang, Bo
    PROCEEDINGS OF THE 2017 2ND JOINT INTERNATIONAL INFORMATION TECHNOLOGY, MECHANICAL AND ELECTRONIC ENGINEERING CONFERENCE (JIMEC 2017), 2017, 62 : 517 - 521
  • [34] Network self attention for forecasting time series
    Hu, Yuntong
    Xiao, Fuyuan
    Applied Soft Computing, 2022, 124
  • [35] VISCOELASTIC FORMULATIONS OF BEM IN TIME AND FREQUENCY-DOMAIN
    GAUL, L
    SCHANZ, M
    FIEDLER, C
    ENGINEERING ANALYSIS WITH BOUNDARY ELEMENTS, 1992, 10 (02) : 137 - 141
  • [36] A COMPARISON OF TIME AND FREQUENCY-DOMAIN GEOMAGNETIC SOUNDING
    BEAMISH, D
    GEOPHYSICAL JOURNAL OF THE ROYAL ASTRONOMICAL SOCIETY, 1983, 73 (03): : 689 - 704
  • [37] Simultaneous time- and frequency-domain extrapolation
    Adve, RS
    Sarkar, TK
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 1998, 46 (04) : 484 - 493
  • [38] TIME AND FREQUENCY-DOMAIN IMPLEMENTATIONS OF DATA WINDOWS
    PRABHU, KMM
    AGRAWAL, JP
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 1979, 33 (05): : 224 - 226
  • [39] Time- and frequency-domain polariton interference
    Campbell, G.
    Hosseini, M.
    Sparkes, B. M.
    Lam, P. K.
    Buchler, B. C.
    NEW JOURNAL OF PHYSICS, 2012, 14
  • [40] TIME AND FREQUENCY-DOMAIN ANALYSES OF HYDROLOGICAL SYSTEMS
    HUTHMANN, G
    WILKE, K
    JOURNAL OF HYDROLOGY, 1982, 55 (1-4) : 347 - 369