Novel MIA-LSTM Deep Learning Hybrid Model with Data Preprocessing for Forecasting of PM2.5

被引:6
|
作者
Narkhede, Gaurav [1 ]
Hiwale, Anil [1 ]
Tidke, Bharat [2 ]
Khadse, Chetan [3 ]
机构
[1] MIT World Peace Univ, Sch Elect & Commun Engn, Pune 411038, India
[2] MIT World Peace Univ, Sch Comp Engn & Technol, Pune 411038, India
[3] MIT World Peace Univ, Sch Elect Engn, Pune 411038, India
关键词
MIA-LSTM; data preprocessing; iterative imputation; autoencoder; LSTM; MISSING VALUES; NEURAL-NETWORK; IMPUTATION; AIR; PREDICTION;
D O I
10.3390/a16010052
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Day by day pollution in cities is increasing due to urbanization. One of the biggest challenges posed by the rapid migration of inhabitants into cities is increased air pollution. Sustainable Development Goal 11 indicates that 99 percent of the world's urban population breathes polluted air. In such a trend of urbanization, predicting the concentrations of pollutants in advance is very important. Predictions of pollutants would help city administrations to take timely measures for ensuring Sustainable Development Goal 11. In data engineering, imputation and the removal of outliers are very important steps prior to forecasting the concentration of air pollutants. For pollution and meteorological data, missing values and outliers are critical problems that need to be addressed. This paper proposes a novel method called multiple iterative imputation using autoencoder-based long short-term memory (MIA-LSTM) which uses iterative imputation using an extra tree regressor as an estimator for the missing values in multivariate data followed by an LSTM autoencoder for the detection and removal of outliers present in the dataset. The preprocessed data were given to a multivariate LSTM for forecasting PM2.5 concentration. This paper also presents the effect of removing outliers and missing values from the dataset as well as the effect of imputing missing values in the process of forecasting the concentrations of air pollutants. The proposed method provides better results for forecasting with a root mean square error (RMSE) value of 9.8883. The obtained results were compared with the traditional gated recurrent unit (GRU), 1D convolutional neural network (CNN), and long short-term memory (LSTM) approaches for a dataset of the Aotizhonhxin area of Beijing in China. Similar results were observed for another two locations in China and one location in India. The results obtained show that imputation and outlier/anomaly removal improve the accuracy of air pollution forecasting.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] DESA: a novel hybrid decomposing-ensemble and spatiotemporal attention model for PM2.5 forecasting
    Fang, Shuwei
    Li, Qi
    Karimian, Hamed
    Liu, Hui
    Mo, Yuqin
    ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2022, 29 (36) : 54150 - 54166
  • [42] A Hybrid Data-Driven and Data Assimilation Method for Spatiotemporal Forecasting: PM2.5 Forecasting in China
    Cai, Shengjuan
    Fang, Fangxin
    Tang, Xiao
    Zhu, Jiang
    Wang, Yanghua
    JOURNAL OF ADVANCES IN MODELING EARTH SYSTEMS, 2024, 16 (02)
  • [43] Deep Neural Network for PM2.5 Pollution Forecasting Based on Manifold Learning
    Xie, Jingjing
    2017 INTERNATIONAL CONFERENCE ON SENSING, DIAGNOSTICS, PROGNOSTICS, AND CONTROL (SDPC), 2017, : 236 - 240
  • [44] PM2.5 forecasting for an urban area based on deep learning and decomposition method
    Zaini, Nur'atiah
    Ean, Lee Woen
    Ahmed, Ali Najah
    Malek, Marlinda Abdul
    Chow, Ming Fai
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [45] An Improved Hybrid Transfer Learning-Based Deep Learning Model for PM2.5 Concentration Prediction
    Ni, Jianjun
    Chen, Yan
    Gu, Yu
    Fang, Xiaolong
    Shi, Pengfei
    APPLIED SCIENCES-BASEL, 2022, 12 (07):
  • [46] PM2.5 forecasting for an urban area based on deep learning and decomposition method
    Nur’atiah Zaini
    Lee Woen Ean
    Ali Najah Ahmed
    Marlinda Abdul Malek
    Ming Fai Chow
    Scientific Reports, 12
  • [47] Short-Term Prediction of PM2.5 Using LSTM Deep Learning Methods
    Kristiani, Endah
    Lin, Hao
    Jwu-Rong Lin
    Yen-Hsun Chuang
    Chin-Yin Huang
    Chao-Tung Yang
    SUSTAINABILITY, 2022, 14 (04)
  • [48] A model for PM2.5 forecasting in Santiago, Chile
    Perez, P.
    Rodriguez, P.
    AIR POLLUTION XIV, 2006, 86 : 95 - +
  • [49] Hybrid forecasting of PM2.5 using SOFM and ELM
    Siwek, Krzysztof
    Grzywacz, Tomasz
    COMPUTER APPLICATIONS IN ELECTRICAL ENGINEERING (ZKWE'2018), 2018, 19
  • [50] An optimized hybrid deep learning model for PM2.5 and O3 concentration prediction
    Juntao Hu
    Yiyuan Chen
    Wei Wang
    Shicheng Zhang
    Can Cui
    Wenke Ding
    Yong Fang
    Air Quality, Atmosphere & Health, 2023, 16 : 857 - 871