Time Series Prediction Based on LSTM-Attention-LSTM Model

被引:39
|
作者
Wen, Xianyun
Li, Weibang [1 ]
机构
[1] Southwest Minzu Univ, Key Lab Comp Syst State Ethn Affairs Commiss, Chengdu 610041, Peoples R China
关键词
Time series forecasting; long short-term memory networks; encoder and decoder model; attention mechanisms;
D O I
10.1109/ACCESS.2023.3276628
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series forecasting uses data from the past periods of time to predict future information, which is of great significance in many applications. Existing time series forecasting methods still have problems such as low accuracy when dealing with some non-stationary multivariate time series data forecasting. Aiming at the shortcomings of existing methods, in this paper we propose a new time series forecasting model LSTM-attention-LSTM. The model uses two LSTM models as the encoder and decoder, and introduces an attention mechanism between the encoder and decoder. The model has two distinctive features: first, by using the attention mechanism to calculate the interrelationship between sequence data, it overcomes the disadvantage of the coder-and-decoder model in that the decoder cannot obtain sufficiently long input sequences; second, it is suitable for sequence forecasting with long time steps. In this paper we validate the proposed model based on several real data sets, and the results show that the LSTM-attention-LSTM model is more accurate than some currently dominant models in prediction. The experiment also assessed the effect of the attention mechanism at different time steps by varying the time step.
引用
收藏
页码:48322 / 48331
页数:10
相关论文
共 50 条
  • [11] Prediction for Time Series with CNN and LSTM
    Jin, Xuebo
    Yu, Xinghong
    Wang, Xiaoyi
    Bai, Yuting
    Su, Tingli
    Kong, Jianlei
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC2019), 2020, 582 : 631 - 641
  • [12] Temperature Time Series Prediction Model Based on Time Series Decomposition and Bi-LSTM Network
    Zhang, Kun
    Huo, Xing
    Shao, Kun
    MATHEMATICS, 2023, 11 (09)
  • [13] CTS-LSTM: LSTM-based neural networks for correlated time series prediction
    Wan, Huaiyu
    Guo, Shengnan
    Yin, Kang
    Liang, Xiaohui
    Lin, Youfang
    KNOWLEDGE-BASED SYSTEMS, 2020, 191
  • [14] PREDICTION ALGORITHM OF INDUSTRY ROTATION BASED ON ATTENTION LSTM MODEL
    Li, Jianming
    Guo, Gewei
    Hu, Xiangpei
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2022, 18 (06): : 1969 - 1977
  • [15] A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism
    Dai, Zhihui
    Zhang, Ming
    Nedjah, Nadia
    Xu, Dong
    Ye, Feng
    WATER, 2023, 15 (04)
  • [16] Time series prediction method based on Convolutional Autoencoder and LSTM
    Zhao, Xia
    Han, Xiao
    Su, Weijun
    Yan, Zhen
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 5790 - 5793
  • [17] Time Series Prediction of Wind Speed Based on SARIMA and LSTM
    Xiong, Caiquan
    Yu, Congcong
    Gu, Xiaohui
    Xu, Shiqiang
    COMPLEX, INTELLIGENT AND SOFTWARE INTENSIVE SYSTEMS, CISIS-2021, 2021, 278 : 57 - 67
  • [18] Attention Based Mechanism for Load Time Series Forecasting: AN-LSTM
    Bedi, Jatin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT I, 2020, 12396 : 838 - 849
  • [19] Time Series Prediction with Autoencoding LSTM Networks
    Succetti, Federico
    Ceschini, Andrea
    Di Luzio, Francesco
    Rosato, Antonello
    Panella, Massimo
    ADVANCES IN COMPUTATIONAL INTELLIGENCE (IWANN 2021), PT II, 2021, 12862 : 306 - 317
  • [20] Based on the Improved PSO-TPA-LSTM Model Chaotic Time Series Prediction
    Cai, Zijian
    Feng, Guolin
    Wang, Qiguang
    ATMOSPHERE, 2023, 14 (11)