A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

被引:17
|
作者
Dai, Zhihui [1 ]
Zhang, Ming [2 ]
Nedjah, Nadia [3 ]
Xu, Dong [4 ]
Ye, Feng [1 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[3] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, BR-20550013 Rio De Janeiro, Brazil
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
seq2seq model; attention mechanism; LSTM model; hydrological prediction; feature analysis; SHORT-TERM-MEMORY;
D O I
10.3390/w15040670
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid development of IoT, big data and artificial intelligence, the research and application of data-driven hydrological models are increasing. However, when conducting time series analysis, many prediction models are often directly based on the following assumptions: hydrologic time series are normal, homogeneous, smooth and non-trending, which are not always all true. To address the related issues, a solution for short-term hydrological forecasting is proposed. Firstly, a feature test is conducted to verify whether the hydrological time series are normal, homogeneous, smooth and non-trending; secondly, a sequence-to-sequence (seq2seq)-based short-term water level prediction model (LSTM-seq2seq) is proposed to improve the accuracy of hydrological prediction. The model uses a long short-term memory neural network (LSTM) as an encoding layer to encode the historical flow sequence into a context vector, and another LSTM as a decoding layer to decode the context vector in order to predict the target runoff, by superimposing on the attention mechanism, aiming at improving the prediction accuracy. Using the experimental data regarding the water level of the Chu River, the model is compared to other models based on the analysis of normality, smoothness, homogeneity and trending of different water level data. The results show that the prediction accuracy of the proposed model is greater than that of the data set without these characteristics for the data set with normality, smoothness, homogeneity and trend. Flow data at Runcheng, Wuzhi, Baima Temple, Longmen Town, Dongwan, Lu's and Tongguan are used as input data sets to train and evaluate the model. Metrics RMSE and NSE are used to evaluate the prediction accuracy and convergence speed of the model. The results show that the prediction accuracy of LSTM-seq2seq and LSTM-BP models is higher than other models. Furthermore, the convergence process of the LSTM-seq2seq model is the fastest among the compared models.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Object tactile character recognition model based on attention mechanism LSTM
    Xu, Zhe
    Chen, Muxin
    Liu, Chunfang
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 7095 - 7100
  • [32] ACLM:Software Aging Prediction of Virtual Machine Monitor Based on Attention Mechanism of CNN-LSTM Model
    Tan, Xueyong
    Liu, Jing
    2021 IEEE 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS 2021), 2021, : 759 - 767
  • [33] Two-channel Attention Mechanism Fusion Model of Stock Price Prediction Based on CNN-LSTM
    Sun, Lin
    Xu, Wenzheng
    Liu, Jimin
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (05)
  • [34] A study on water quality prediction by a hybrid CNN-LSTM model with attention mechanism
    Yurong Yang
    Qingyu Xiong
    Chao Wu
    Qinghong Zou
    Yang Yu
    Hualing Yi
    Min Gao
    Environmental Science and Pollution Research, 2021, 28 : 55129 - 55139
  • [35] A study on water quality prediction by a hybrid CNN-LSTM model with attention mechanism
    Yang, Yurong
    Xiong, Qingyu
    Wu, Chao
    Zou, Qinghong
    Yu, Yang
    Yi, Hualing
    Gao, Min
    ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2021, 28 (39) : 55129 - 55139
  • [36] Grain protein function prediction based on self-attention mechanism and bidirectional LSTM
    Liu, Jing
    Tang, Xinghua
    Guan, Xiao
    BRIEFINGS IN BIOINFORMATICS, 2023, 24 (01)
  • [37] A Prediction Method of Seedling Transplanting Time with DCNN-LSTM Based on the Attention Mechanism
    Zhu, Huaji
    Liu, Chang
    Wu, Huarui
    AGRONOMY-BASEL, 2022, 12 (07):
  • [38] Fuel Ratio Prediction Model Based on Attention Mechanism
    Li, Yihan
    Cao, Weihua
    Hu, Wenkai
    Yuan, Yan
    2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 1546 - 1550
  • [39] Prediction of reservoir water levels via an improved attention mechanism based on CNN - LSTM
    Li, Haoran
    Zhang, Lili
    Yao, Yunsheng
    Zhang, Yaowen
    APPLIED INTELLIGENCE, 2025, 55 (06)
  • [40] Disease Prediction Model Based on BiLSTM and Attention Mechanism
    Yang, Yang
    Zheng, Xiangwei
    Ji, Cun
    2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 1141 - 1148