Time Series Prediction Based on LSTM-Attention-LSTM Model

被引:39
|
作者
Wen, Xianyun
Li, Weibang [1 ]
机构
[1] Southwest Minzu Univ, Key Lab Comp Syst State Ethn Affairs Commiss, Chengdu 610041, Peoples R China
关键词
Time series forecasting; long short-term memory networks; encoder and decoder model; attention mechanisms;
D O I
10.1109/ACCESS.2023.3276628
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Time series forecasting uses data from the past periods of time to predict future information, which is of great significance in many applications. Existing time series forecasting methods still have problems such as low accuracy when dealing with some non-stationary multivariate time series data forecasting. Aiming at the shortcomings of existing methods, in this paper we propose a new time series forecasting model LSTM-attention-LSTM. The model uses two LSTM models as the encoder and decoder, and introduces an attention mechanism between the encoder and decoder. The model has two distinctive features: first, by using the attention mechanism to calculate the interrelationship between sequence data, it overcomes the disadvantage of the coder-and-decoder model in that the decoder cannot obtain sufficiently long input sequences; second, it is suitable for sequence forecasting with long time steps. In this paper we validate the proposed model based on several real data sets, and the results show that the LSTM-attention-LSTM model is more accurate than some currently dominant models in prediction. The experiment also assessed the effect of the attention mechanism at different time steps by varying the time step.
引用
收藏
页码:48322 / 48331
页数:10
相关论文
共 50 条
  • [21] TE-LSTM: A Prediction Model for Temperature Based on Multivariate Time Series Data
    Zhou, Kang
    Zhang, Chunju
    Xu, Bing
    Huang, Jianwei
    Li, Chenxi
    Pei, Yifan
    REMOTE SENSING, 2024, 16 (19)
  • [22] An LSTM-Based Method with Attention Mechanism for Travel Time Prediction
    Ran, Xiangdong
    Shan, Zhiguang
    Fang, Yufei
    Lin, Chuang
    SENSORS, 2019, 19 (04)
  • [23] Two-dimensional attention-based multi-input LSTM for time series prediction
    Kim, Eun Been
    Park, Jung Hoon
    Lee, Yung-Seop
    Lim, Changwon
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2021, 28 (01) : 39 - 57
  • [24] Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism
    Teng, Yingzhi
    Liu, Jing
    Wu, Kai
    NEURAL PROCESSING LETTERS, 2024, 56 (05)
  • [25] Temporal self-attention-based Conv-LSTM network for multivariate time series prediction
    Fu, En
    Zhang, Yinong
    Yang, Fan
    Wang, Shuying
    NEUROCOMPUTING, 2022, 501 : 162 - 173
  • [26] PT-LSTM: Extending LSTM for Efficient Processing Time Attributes in Time Series Prediction
    Yu, Yongqiang
    Xia, Xinyi
    Lang, Bo
    Liu, Hongyu
    WEB AND BIG DATA, APWEB-WAIM 2021, PT I, 2021, 12858 : 450 - 464
  • [27] LSTM Road Traffic Accident Prediction Model Based on Attention Mechanism
    Wang, Shunshun
    Yan, Changshun
    Shao, Yong
    2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA, 2023, : 215 - 219
  • [28] Financial time series forecasting model based on CEEMDAN and LSTM
    Cao, Jian
    Li, Zhi
    Li, Jian
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2019, 519 : 127 - 139
  • [29] Interval prediction for time series based on LSTM and mixed Gaussian distribution
    Xie, Zongxia
    Li, Renhui
    Hu, Hui
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2648 - 2655
  • [30] Research on the prediction of short time series based on EMD-LSTM
    Liu, Yongzhi
    Wu, Gang
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2023, 23 (05) : 2511 - 2524