Retrieval of missing values in water temperature series using a data-driven model

被引:0
|
作者
Iyan E. Mulia
Toshiyuki Asano
Pavel Tkalich
机构
[1] Kagoshima University,Department of Ocean and Civil Engineering
[2] National University of Singapore,Tropical Marine Science Institute
来源
关键词
Water temperature; Artificial neural network; Genetic algorithm; Kohonen self-organizing map; Wavelet decomposition; Water quality;
D O I
暂无
中图分类号
学科分类号
摘要
A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circumstances the sensors may fail to provide continuous and high quality data. This results in gaps or corrupted values. The aim of this study was to reconstruct the faulty values. This paper proposes a method based on a data-driven model, using an Artificial Neural Network combined with a Genetic Algorithm to generate a synthetic data series. The generated data can be used as a patch for the incomplete measured data. Additional improvements were achieved by removing seasonal patterns from the original time series using a wavelet decomposition prior to the data-driven model training process. Comparisons with a standard missing-data imputation method using the Kohonen self-organizing map were made to further asses the performance of the proposed data-driven model. The algorithm was applied to water temperature data, but the same approach is applicable to other parameters of interest.
引用
收藏
页码:787 / 798
页数:11
相关论文
共 50 条
  • [1] Retrieval of missing values in water temperature series using a data-driven model
    Mulia, Iyan E.
    Asano, Toshiyuki
    Tkalich, Pavel
    EARTH SCIENCE INFORMATICS, 2015, 8 (04) : 787 - 798
  • [2] A New Approach to Dealing With Missing Values in Data-driven Fuzzy Modeling
    Almeida, Rui J.
    Kaymak, Uzay
    Sousa, Joao M. C.
    2010 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE 2010), 2010,
  • [3] Data-Driven Evidential Belief Modeling of Mineral Potential Using Few Prospects and Evidence with Missing Values
    Carranza, Emmanuel John M.
    NATURAL RESOURCES RESEARCH, 2015, 24 (03) : 291 - 304
  • [4] Data-Driven Evidential Belief Modeling of Mineral Potential Using Few Prospects and Evidence with Missing Values
    Emmanuel John M. Carranza
    Natural Resources Research, 2015, 24 : 291 - 304
  • [5] A data-driven method for detecting and diagnosing causes of water quality contamination in a dataset with a high rate of missing values
    Ngouna, Raymond Houe
    Ratolojanahary, Romy
    Medjaher, Kamal
    Dauriac, Fabien
    Sebilo, Mathieu
    Junca-Bourie, Jean
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 95
  • [6] Data-Driven Computational Algorithms for Predicting Electricity Consumption Missing Values: A Comparative Study
    Hanna, Bavly
    Xu, Guandong
    Wang, Xianzhi
    Hossain, Jahangir
    2022 32ND AUSTRALASIAN UNIVERSITIES POWER ENGINEERING CONFERENCE, AUPEC, 2022,
  • [7] Data-driven Missing Data Imputation for Wind Farms Using Context Encoder
    Liao, Wenlong
    Bak-Jensen, Birgitte
    Pillai, Jayakrishnan Radhakrishna
    Yang, Dechang
    Wang, Yusen
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2022, 10 (04) : 964 - 976
  • [8] Data-driven Missing Data Imputation for Wind Farms Using Context Encoder
    Wenlong Liao
    Birgitte Bak-Jensen
    Jayakrishnan Radhakrishna Pillai
    Dechang Yang
    Yusen Wang
    Journal of Modern Power Systems and Clean Energy, 2022, 10 (04) : 964 - 976
  • [9] Data-driven Buck converter model identification method with missing outputs
    Hou, Jie
    Zhang, Xinhua
    Wang, Huiming
    Wang, Shiwei
    IET CONTROL THEORY AND APPLICATIONS, 2024, 18 (14): : 1825 - 1835
  • [10] Data-Driven Machine Learning Approach for Predicting Missing Values in Large Data Sets: A Comparison Study
    Elezaj, Ogerta
    Yildirim, Sule
    Kalemi, Edlira
    MACHINE LEARNING, OPTIMIZATION, AND BIG DATA, MOD 2017, 2018, 10710 : 268 - 285