A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

被引:17
|
作者
Dai, Zhihui [1 ]
Zhang, Ming [2 ]
Nedjah, Nadia [3 ]
Xu, Dong [4 ]
Ye, Feng [1 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[3] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, BR-20550013 Rio De Janeiro, Brazil
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
seq2seq model; attention mechanism; LSTM model; hydrological prediction; feature analysis; SHORT-TERM-MEMORY;
D O I
10.3390/w15040670
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid development of IoT, big data and artificial intelligence, the research and application of data-driven hydrological models are increasing. However, when conducting time series analysis, many prediction models are often directly based on the following assumptions: hydrologic time series are normal, homogeneous, smooth and non-trending, which are not always all true. To address the related issues, a solution for short-term hydrological forecasting is proposed. Firstly, a feature test is conducted to verify whether the hydrological time series are normal, homogeneous, smooth and non-trending; secondly, a sequence-to-sequence (seq2seq)-based short-term water level prediction model (LSTM-seq2seq) is proposed to improve the accuracy of hydrological prediction. The model uses a long short-term memory neural network (LSTM) as an encoding layer to encode the historical flow sequence into a context vector, and another LSTM as a decoding layer to decode the context vector in order to predict the target runoff, by superimposing on the attention mechanism, aiming at improving the prediction accuracy. Using the experimental data regarding the water level of the Chu River, the model is compared to other models based on the analysis of normality, smoothness, homogeneity and trending of different water level data. The results show that the prediction accuracy of the proposed model is greater than that of the data set without these characteristics for the data set with normality, smoothness, homogeneity and trend. Flow data at Runcheng, Wuzhi, Baima Temple, Longmen Town, Dongwan, Lu's and Tongguan are used as input data sets to train and evaluate the model. Metrics RMSE and NSE are used to evaluate the prediction accuracy and convergence speed of the model. The results show that the prediction accuracy of LSTM-seq2seq and LSTM-BP models is higher than other models. Furthermore, the convergence process of the LSTM-seq2seq model is the fastest among the compared models.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Improved LSTM Based on Attention Mechanism for Short-term Traffic Flow Prediction
    Chen, Dejun
    Xiong, Congcong
    Zhong, Ming
    2020 10TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2020, : 71 - 76
  • [42] Vehicle Trajectory Prediction Based on LSTM-GRU Integrating Dropout and Attention Mechanism
    Wu X.
    Wei Y.
    Wang A.
    Lei Y.
    Zhang R.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (04): : 65 - 75
  • [43] Adaptive Robust Prediction of Groundwater Level Based on Fusion Attention Mechanism LSTM Network
    Dian, Songyi
    Li, Xiaoying
    Yang, Dan
    Rui, Shengyang
    Guo, Bin
    Gongcheng Kexue Yu Jishu/Advanced Engineering Sciences, 2024, 56 (01): : 54 - 64
  • [44] An Improved Generating Energy Prediction Method Based on Bi-LSTM and Attention Mechanism
    He, Bo
    Ma, Runze
    Zhang, Wenwei
    Zhu, Jun
    Zhang, Xingyuan
    ELECTRONICS, 2022, 11 (12)
  • [45] A hybrid model for missing traffic flow data imputation based on clustering and attention mechanism optimizing LSTM and AdaBoost
    Shang, Qiang
    Tang, Yingping
    Yin, Longjiao
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [46] An Improved Attention-based Bidirectional LSTM Model for Cyanobacterial Bloom Prediction
    Jianjun Ni
    Ruping Liu
    Guangyi Tang
    Yingjuan Xie
    International Journal of Control, Automation and Systems, 2022, 20 : 3445 - 3455
  • [47] A new attention-based LSTM model for closing stock price prediction
    Lin, Yuyang
    Huang, Qi
    Zhong, Qiyin
    Li, Muyang
    Li, Yan
    Ma, Fei
    INTERNATIONAL JOURNAL OF FINANCIAL ENGINEERING, 2022, 09 (03)
  • [48] Ionospheric TEC Prediction in China Based on the Multiple-Attention LSTM Model
    Liu, Haijun
    Lei, Dongxing
    Yuan, Jing
    Yuan, Guoming
    Cui, Chunjie
    Wang, Yali
    Xue, Wei
    ATMOSPHERE, 2022, 13 (11)
  • [49] Driver Takeover Performance Prediction Based on LSTM-BiLSTM-ATTENTION Model
    Chen, Lijie
    Li, Daofei
    Wang, Tao
    Chen, Jun
    Yuan, Quan
    SYSTEMS, 2025, 13 (01):
  • [50] Vehicle Destination Prediction Using Bidirectional LSTM with Attention Mechanism
    Casabianca, Pietro
    Zhang, Yu
    Martinez-Garcia, Miguel
    Wan, Jiafu
    SENSORS, 2021, 21 (24)