Time Series Prediction Based on LSTM-Attention-LSTM Model

被引:39
|
作者
Wen, Xianyun
Li, Weibang [1 ]
机构
[1] Southwest Minzu Univ, Key Lab Comp Syst State Ethn Affairs Commiss, Chengdu 610041, Peoples R China
关键词
Time series forecasting; long short-term memory networks; encoder and decoder model; attention mechanisms;
D O I
10.1109/ACCESS.2023.3276628
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series forecasting uses data from the past periods of time to predict future information, which is of great significance in many applications. Existing time series forecasting methods still have problems such as low accuracy when dealing with some non-stationary multivariate time series data forecasting. Aiming at the shortcomings of existing methods, in this paper we propose a new time series forecasting model LSTM-attention-LSTM. The model uses two LSTM models as the encoder and decoder, and introduces an attention mechanism between the encoder and decoder. The model has two distinctive features: first, by using the attention mechanism to calculate the interrelationship between sequence data, it overcomes the disadvantage of the coder-and-decoder model in that the decoder cannot obtain sufficiently long input sequences; second, it is suitable for sequence forecasting with long time steps. In this paper we validate the proposed model based on several real data sets, and the results show that the LSTM-attention-LSTM model is more accurate than some currently dominant models in prediction. The experiment also assessed the effect of the attention mechanism at different time steps by varying the time step.
引用
收藏
页码:48322 / 48331
页数:10
相关论文
共 50 条
  • [31] LSTM Model-Based Rapid Prediction Method of Urban Inundation with Rainfall Time Series
    Pan, Xinxin
    Hou, Jingming
    Gao, Xujun
    Chen, Guangzhao
    Li, Donglai
    Imran, Muhammad
    Li, Xinyi
    Yang, Nan
    Ma, Menghua
    Zhou, Xiaoping
    WATER RESOURCES MANAGEMENT, 2025, 39 (02) : 661 - 688
  • [32] Context-based Hydrology Time Series Data for A Flood Prediction Model Using LSTM
    Widiasari, Indrastanti R.
    Nugoho, Lukito Edi
    Widyawan
    Efendi, Rissal
    2018 5TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, COMPUTER, AND ELECTRICAL ENGINEERING (ICITACEE), 2018, : 385 - 390
  • [33] Hyperparameter Optimization of a Parallelized LSTM for Time Series Prediction
    Ozturk, Muhammed Maruf
    VIETNAM JOURNAL OF COMPUTER SCIENCE, 2023, 10 (03) : 303 - 328
  • [34] A Combined Model for Multivariate Time Series Forecasting Based on MLP-Feedforward Attention-LSTM
    Liu, Yuntong
    Zhao, Chunna
    Huang, Yaqun
    IEEE ACCESS, 2022, 10 : 88644 - 88654
  • [35] A dual-stage attention-based Bi-LSTM network for multivariate time series prediction
    Qi Cheng
    Yixin Chen
    Yuteng Xiao
    Hongsheng Yin
    Weidong Liu
    The Journal of Supercomputing, 2022, 78 : 16214 - 16235
  • [36] A dual-stage attention-based Bi-LSTM network for multivariate time series prediction
    Cheng, Qi
    Chen, Yixin
    Xiao, Yuteng
    Yin, Hongsheng
    Liu, Weidong
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (14): : 16214 - 16235
  • [37] Hospitalization Behavior Prediction Based on Attention and Time Adjustment Factors in Bidirectional LSTM
    Cheng, Lin
    Ren, Yongjian
    Zhang, Kun
    Pan, Li
    Shi, Yuliang
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, 2019, 11448 : 397 - 401
  • [38] Improving time series forecasting using LSTM and attention models
    Abbasimehr, Hossein
    Paki, Reza
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2022, 13 (01) : 673 - 691
  • [39] Improving time series forecasting using LSTM and attention models
    Hossein Abbasimehr
    Reza Paki
    Journal of Ambient Intelligence and Humanized Computing, 2022, 13 : 673 - 691
  • [40] Ionospheric TEC prediction based on Attention-LSTM
    Liu HaiJun
    Lei Dongxing
    Yuan jing
    Le HuiJun
    Shan WeiFeng
    Li Liangchao
    Wang HaoRan
    Li Zhong
    Yuan GuoMing
    CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2024, 67 (02): : 439 - 451