Multi-indicator water quality prediction with attention-assisted bidirectional LSTM and encoder-decoder

被引:38
|
作者
Bi, Jing [1 ]
Zhang, Luyao [1 ]
Yuan, Haitao [2 ]
Zhang, Jia [3 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Sch Software Engn, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] Southern Methodist Univ, Lyle Sch Engn, Dept Comp Sci, Dallas, TX 75205 USA
基金
中国国家自然科学基金;
关键词
Water quality prediction; LSTM; Variational modal decomposition; Particle swarm optimization; Encoder; -decoder; NEURAL-NETWORK; PARTICLE SWARM;
D O I
10.1016/j.ins.2022.12.091
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate and real-time prediction of water quality not only helps to assess the environ-mental quality of water, but also effectively prevents and controls water quality emergen-cies. In recent years, neural networks represented by Bidirectional Long Short-Term Memory (BiLSTM) and Encoder-Decoder (ED) frameworks have been shown to be suitable for prediction of time series data. However, traditional statistical methods cannot capture nonlinear characteristics of the water quality, and deep learning models often suffer from gradient disappearance and gradient explosion problems. This work proposes a hybrid water quality prediction method called SVABEG, which combines a Savitzky-Golay (SG) fil-ter, Variational Mode Decomposition (VMD), an Attention mechanism, BiLSTM, an ED structure, and a hybrid algorithm called Genetic Simulated annealing-based Particle Swarm Optimization (GSPSO). SVABEG first adopts the SG filter and VMD to remove noise and deal with nonlinear features in the original time series, respectively. Then, SVABEG combines BiLSTM, the ED structure and the attention mechanism to capture bi-directional long-term correlations, realize dimensionality reduction and extract key infor-mation, respectively. Furthermore, SVABEG adopts GSPSO to optimize its hyperparameters. Experimental results with real-life datasets demonstrate that the proposed SVABEG out-performs current state-of-the-art algorithms in terms of prediction accuracy. (c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页码:65 / 80
页数:16
相关论文
共 50 条
  • [31] DyGCN-LSTM: A dynamic GCN-LSTM based encoder-decoder framework for multistep traffic prediction
    Kumar, Rahul
    Moreira, Joao Mendes
    Chandra, Joydeep
    APPLIED INTELLIGENCE, 2023, 53 (21) : 25388 - 25411
  • [32] Improved network intrusion classification with attention-assisted bidirectional LSTM and optimized sparse contractive autoencoders
    Bi, Jing
    Guan, Ziyue
    Yuan, Haitao
    Zhang, Jia
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 244
  • [33] Tool health monitoring and prediction via attention-based encoder-decoder with a multi-step mechanism
    Guo, Baosu
    Zhang, Qin
    Peng, Qinjing
    Zhuang, Jichao
    Wu, Fenghe
    Zhang, Quan
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 122 (02): : 685 - 695
  • [34] Tool health monitoring and prediction via attention-based encoder-decoder with a multi-step mechanism
    Baosu Guo
    Qin Zhang
    Qinjing Peng
    Jichao Zhuang
    Fenghe Wu
    Quan Zhang
    The International Journal of Advanced Manufacturing Technology, 2022, 122 : 685 - 695
  • [35] An Encoder-Decoder Approach to Handwritten Mathematical Expression Recognition with Multi-head Attention and Stacked Decoder
    Ding, Haisong
    Chen, Kai
    Huo, Qiang
    DOCUMENT ANALYSIS AND RECOGNITION - ICDAR 2021, PT II, 2021, 12822 : 602 - 616
  • [36] A novel Encoder-Decoder model based on read-first LSTM for air pollutant prediction
    Zhang, Bo
    Zou, Guojian
    Qin, Dongming
    Lu, Yunjie
    Jin, Yupeng
    Wang, Hui
    SCIENCE OF THE TOTAL ENVIRONMENT, 2021, 765 (765)
  • [37] Aircraft Bleed Air System Fault Prediction based on Encoder-Decoder with Attention Mechanism
    Su, Siyu
    Sun, Youchao
    Peng, Chong
    Wang, Yifan
    EKSPLOATACJA I NIEZAWODNOSC-MAINTENANCE AND RELIABILITY, 2023, 25 (03):
  • [38] Hierarchical encoder-decoder architecture for carrier airwake prediction using attention in frequency domain
    Yang, Yuhao
    Zheng, Zewei
    2023 2ND CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, CFASTA, 2023, : 630 - 635
  • [39] A Novel Dynamic Attack on Classical Ciphers Using an Attention-Based LSTM Encoder-Decoder Model
    Ahmadzadeh, Ezat
    Kim, Hyunil
    Jeong, Ongee
    Moon, Inkyu
    IEEE ACCESS, 2021, 9 (09): : 60960 - 60970
  • [40] The Use of Attention-Enhanced CNN-LSTM Models for Multi-Indicator and Time-Series Predictions of Surface Water Quality
    Zhang, Minhao
    Zhang, Zhiyu
    Wang, Xuan
    Liao, Zhenliang
    Wang, Lijin
    WATER RESOURCES MANAGEMENT, 2024, 38 (15) : 6103 - 6119