FAITH: Frequency-domain Attention In Two Horizons for time series forecasting

被引:0
|
作者
Li, Ruiqi [1 ,2 ,3 ]
Jiang, Maowei [1 ,2 ,3 ]
Liu, Quangao [1 ,2 ,3 ]
Wang, Kai [1 ,2 ]
Feng, Kaiduo [1 ,2 ,3 ]
Sun, Yue [4 ]
Zhou, Xiufang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shenyang Univ Technol, Sch Informat Sci & Engn, Shenyang 110870, Peoples R China
关键词
Time series forecasting; Frequency domain; Channel; Attention mechanism; Real world datasets;
D O I
10.1016/j.knosys.2024.112790
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time Series Forecasting (TSF) plays a crucial role in various sectors, including industrial maintenance, weather prediction, energy management, traffic control, and financial planning. Current deep learning-based predictive models often exhibit significant deviations between their forecasting outcomes and the ground truth because they lack an efficient method to extract both the global frequency-domain information of each variable and the relationships between different variables. To tackle this challenge, we introduce an innovative model- Frequency-domain Attention In Two Horizons (FAITH). FAITH decomposes time series into trend and seasonal components using a multi-scale adaptive decomposition and fusion architecture and processes them separately. It utilizes two modules - the Frequency Channel Feature Extraction Module (FCEM) and the Frequency Temporal Feature Extraction Module (FTEM) - to capture inter-channel relationships at a finer granularity and to extract global temporal information from the frequency domain of different variables. This significantly enhances its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time-frequency domain transformation method, effectively reducing computational costs. Extensive experiments across six benchmarks for long-term forecasting and five benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in various domains, such as electricity, weather, and traffic. These results validate the effectiveness and superiority of FAITH in both long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH
引用
收藏
页数:12
相关论文
共 50 条
  • [21] CALCULATION OF FREQUENCY-DOMAIN PARAMETERS BY TIME DOMAIN METHODS
    DEHLER, M
    DOHLUS, M
    WEILAND, T
    IEEE TRANSACTIONS ON MAGNETICS, 1992, 28 (02) : 1797 - 1800
  • [22] ON FREQUENCY-DOMAIN AND TIME-DOMAIN PHASE UNWRAPPING
    ZIMMERMANN, KP
    PROCEEDINGS OF THE IEEE, 1987, 75 (04) : 519 - 520
  • [23] SCREENING MEASUREMENTS IN THE TIME DOMAIN AND THEIR CONVERSION INTO THE FREQUENCY-DOMAIN
    FOWLER, EP
    JOURNAL OF THE INSTITUTION OF ELECTRONIC AND RADIO ENGINEERS, 1985, 55 (04): : 127 - 132
  • [24] Time-domain and frequency-domain differential calorimetry
    Ferrari, C
    Salvetti, G
    Tognoni, E
    Tombari, E
    JOURNAL OF THERMAL ANALYSIS, 1996, 47 (01): : 75 - 85
  • [25] Time and Frequency-Domain Spectroscopy with Dual Frequency Combs
    Newbury, N. R.
    Coddington, I.
    Swann, W. C.
    2009 CONFERENCE ON LASERS AND ELECTRO-OPTICS AND QUANTUM ELECTRONICS AND LASER SCIENCE CONFERENCE (CLEO/QELS 2009), VOLS 1-5, 2009, : 359 - 360
  • [26] Transforming characteristic of phase-shift from frequency-domain to time-domain in frequency-domain holography
    Dong, Jun
    Lu, Zhong-gui
    Sun, Zhi-hong
    Peng, Zhi-tao
    Xia, Yan-wen
    Su, Jing-qin
    Jing, Feng
    Yuan, Hao-yu
    Liu, Hua
    Tang, Jun
    OPTICS AND LASER TECHNOLOGY, 2012, 44 (03): : 594 - 599
  • [27] Domain Generalization in Time Series Forecasting
    Deng, Songgaojun
    Sprangers, Olivier
    Li, Ming
    Schelter, Sebastian
    De Rijke, Maarten
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (05)
  • [28] A Frequency-domain Based Test for Non-correlation between Stationary Time Series
    Michael Eichler
    Metrika, 2007, 65 : 133 - 157
  • [29] A frequency-domain based test for non-correlation between stationary time series
    Eichler, Michael
    METRIKA, 2007, 65 (02) : 133 - 157
  • [30] WEIGHTED LEAST-SQUARES ESTIMATORS ON THE FREQUENCY-DOMAIN FOR THE PARAMETERS OF A TIME-SERIES
    CHIU, ST
    ANNALS OF STATISTICS, 1988, 16 (03): : 1315 - 1326