A Hydrological Data Prediction Model Based on LSTM with Attention Mechanism

被引:17
|
作者
Dai, Zhihui [1 ]
Zhang, Ming [2 ]
Nedjah, Nadia [3 ]
Xu, Dong [4 ]
Ye, Feng [1 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[2] Water Resources Dept Jiangsu Prov, Nanjing 210029, Peoples R China
[3] Univ Estado Rio De Janeiro, Engn Fac, Dept Elect Engn & Telecommun, BR-20550013 Rio De Janeiro, Brazil
[4] Hohai Univ, Coll Water Conservancy & Hydropower Engn, Nanjing 211100, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
seq2seq model; attention mechanism; LSTM model; hydrological prediction; feature analysis; SHORT-TERM-MEMORY;
D O I
10.3390/w15040670
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
With the rapid development of IoT, big data and artificial intelligence, the research and application of data-driven hydrological models are increasing. However, when conducting time series analysis, many prediction models are often directly based on the following assumptions: hydrologic time series are normal, homogeneous, smooth and non-trending, which are not always all true. To address the related issues, a solution for short-term hydrological forecasting is proposed. Firstly, a feature test is conducted to verify whether the hydrological time series are normal, homogeneous, smooth and non-trending; secondly, a sequence-to-sequence (seq2seq)-based short-term water level prediction model (LSTM-seq2seq) is proposed to improve the accuracy of hydrological prediction. The model uses a long short-term memory neural network (LSTM) as an encoding layer to encode the historical flow sequence into a context vector, and another LSTM as a decoding layer to decode the context vector in order to predict the target runoff, by superimposing on the attention mechanism, aiming at improving the prediction accuracy. Using the experimental data regarding the water level of the Chu River, the model is compared to other models based on the analysis of normality, smoothness, homogeneity and trending of different water level data. The results show that the prediction accuracy of the proposed model is greater than that of the data set without these characteristics for the data set with normality, smoothness, homogeneity and trend. Flow data at Runcheng, Wuzhi, Baima Temple, Longmen Town, Dongwan, Lu's and Tongguan are used as input data sets to train and evaluate the model. Metrics RMSE and NSE are used to evaluate the prediction accuracy and convergence speed of the model. The results show that the prediction accuracy of LSTM-seq2seq and LSTM-BP models is higher than other models. Furthermore, the convergence process of the LSTM-seq2seq model is the fastest among the compared models.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Accident risk prediction model based on attention-mechanism LSTM using modality convergence in multimodal
    Baek J.-W.
    Chung K.
    Personal and Ubiquitous Computing, 2023, 27 (03) : 1179 - 1189
  • [22] Bearing Remaining Useful Life Prediction Based on a Scaled Health Indicator and a LSTM Model with Attention Mechanism
    Gao, Songhao
    Xiong, Xin
    Zhou, Yanfei
    Zhang, Jiashuo
    MACHINES, 2021, 9 (10)
  • [23] Bus-Passenger-Flow Prediction Model Based on WPD, Attention Mechanism, and Bi-LSTM
    Pei, Yulong
    Ran, Songmin
    Wang, Wanjiao
    Dong, Chuntong
    SUSTAINABILITY, 2023, 15 (20)
  • [24] Spatiotemporal Data Prediction Model Based on a Multi-Layer Attention Mechanism
    Jiang, Man
    Han, Qilong
    Zhang, Haitao
    Liu, Hexiang
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (02)
  • [25] Research on Fault Prediction of Track Circuit Based on Bidirectional LSTM and Attention Mechanism
    Dai S.
    Na L.
    Liang X.
    Tiedao Xuebao/Journal of the China Railway Society, 2023, 45 (09): : 94 - 102
  • [26] An LSTM-based Traffic Prediction Algorithm with Attention Mechanism for Satellite Network
    Zhu, Feiyue
    Liu, Lixiang
    Lin, Teng
    AIPR 2020: 2020 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND PATTERN RECOGNITION, 2020, : 205 - 209
  • [27] An attention mechanism-based LSTM network for cancer kinase activity prediction
    Danishuddin
    Kumar, V.
    Lee, G.
    Yoo, J.
    Ro, H. S.
    Lee, K. W.
    SAR AND QSAR IN ENVIRONMENTAL RESEARCH, 2022, 33 (08) : 631 - 647
  • [28] ANN-LSTM-A Water Consumption Prediction Based on Attention Mechanism Enhancement
    Zhou, Xin
    Meng, Xin
    Li, Zhenyu
    ENERGIES, 2024, 17 (05)
  • [29] A Defect Data Compensation Model for Infrared Thermal Imaging Based on Bi-LSTM with Attention Mechanism
    Cheng, Fei
    Peng, Lei
    Zhu, Hongqiu
    Zhou, Can
    Dai, Yusi
    Peng, Tianyu
    JOM, 2024, 76 (06) : 3028 - 3038
  • [30] A Defect Data Compensation Model for Infrared Thermal Imaging Based on Bi-LSTM with Attention Mechanism
    Fei Cheng
    Lei Peng
    Hongqiu Zhu
    Can Zhou
    Yusi Dai
    Tianyu Peng
    JOM, 2024, 76 : 3028 - 3038