FAITH: Frequency-domain Attention In Two Horizons for time series forecasting

被引:0
|
作者
Li, Ruiqi [1 ,2 ,3 ]
Jiang, Maowei [1 ,2 ,3 ]
Liu, Quangao [1 ,2 ,3 ]
Wang, Kai [1 ,2 ]
Feng, Kaiduo [1 ,2 ,3 ]
Sun, Yue [4 ]
Zhou, Xiufang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shenyang Univ Technol, Sch Informat Sci & Engn, Shenyang 110870, Peoples R China
关键词
Time series forecasting; Frequency domain; Channel; Attention mechanism; Real world datasets;
D O I
10.1016/j.knosys.2024.112790
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time Series Forecasting (TSF) plays a crucial role in various sectors, including industrial maintenance, weather prediction, energy management, traffic control, and financial planning. Current deep learning-based predictive models often exhibit significant deviations between their forecasting outcomes and the ground truth because they lack an efficient method to extract both the global frequency-domain information of each variable and the relationships between different variables. To tackle this challenge, we introduce an innovative model- Frequency-domain Attention In Two Horizons (FAITH). FAITH decomposes time series into trend and seasonal components using a multi-scale adaptive decomposition and fusion architecture and processes them separately. It utilizes two modules - the Frequency Channel Feature Extraction Module (FCEM) and the Frequency Temporal Feature Extraction Module (FTEM) - to capture inter-channel relationships at a finer granularity and to extract global temporal information from the frequency domain of different variables. This significantly enhances its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time-frequency domain transformation method, effectively reducing computational costs. Extensive experiments across six benchmarks for long-term forecasting and five benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in various domains, such as electricity, weather, and traffic. These results validate the effectiveness and superiority of FAITH in both long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Time- and frequency-domain characteristics of LEMP
    Karwowski, A
    ELECTROMAGNETIC COMPATIBILITY 1996 - THIRTEENTH INTERNATIONAL WROCLAW SYMPOSIUM, 1996, : 489 - 493
  • [42] Time/frequency-domain simulation of propagation on interconnects
    Huret, F
    Servel, G
    Paleczny, E
    Kennis, P
    Deschacht, D
    ISIC-99: 8TH INTERNATIONAL SYMPOSIUM ON INTEGRATED CIRCUITS, DEVICES & SYSTEMS, PROCEEDINGS, 1999, : 398 - 401
  • [43] TREATMENT OF THERMAL GRATINGS IN THE TIME AND FREQUENCY-DOMAIN
    JAUREGUI, JA
    WELSCH, E
    JOURNAL OF MODERN OPTICS, 1993, 40 (11) : 2173 - 2198
  • [44] FEDAF: frequency enhanced decomposed attention free transformer for long time series forecasting
    Yang X.
    Li H.
    Huang X.
    Feng X.
    Neural Computing and Applications, 2024, 36 (26) : 16271 - 16288
  • [45] FREQUENCY-DOMAIN ANALYSIS OF TIME INTEGRATION OPERATORS
    PREUMONT, A
    EARTHQUAKE ENGINEERING & STRUCTURAL DYNAMICS, 1982, 10 (05): : 691 - 697
  • [46] Multi-Resolution Expansion of Analysis in Time-Frequency Domain for Time Series Forecasting
    Yan, Kaiwen
    Long, Chen
    Wu, Huisi
    Wen, Zhenkun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6667 - 6680
  • [47] SENSITIVITY OF TIME-DOMAIN RESPONSE TO FREQUENCY-DOMAIN ERRORS
    EDGAR, TF
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1976, 7 (06) : 691 - 698
  • [48] CALCULATING FREQUENCY-DOMAIN DATA BY TIME-DOMAIN METHODS
    DEHLER, M
    DOHLUS, M
    WEILAND, T
    INTERNATIONAL JOURNAL OF NUMERICAL MODELLING-ELECTRONIC NETWORKS DEVICES AND FIELDS, 1993, 6 (01) : 19 - 27
  • [49] TIME-DOMAIN AND FREQUENCY-DOMAIN ANALYSES OF FIELD OBSERVATIONS
    SHUMWAY, RH
    BIGGAR, JW
    MORKOC, F
    BAZZA, M
    NIELSEN, DR
    SOIL SCIENCE, 1989, 147 (04) : 286 - 298
  • [50] On the integral frequency-domain/time-domain relationship of MTIE (τ, β)
    Tavella, P
    EUROPEAN TRANSACTIONS ON TELECOMMUNICATIONS, 1998, 9 (06): : 569 - 570