Methods for interpolating missing data in aerobiological databases

被引:24
|
作者
Picornell, A. [1 ]
Oteros, J. [2 ,3 ]
Ruiz-Mata, R. [1 ]
Recio, M. [1 ]
Trigo, M. M. [1 ]
Martinez-Bracero, M. [2 ,3 ,4 ]
Lara, B. [5 ]
Serrano-Garcia, A. [5 ]
Galan, C. [2 ,3 ]
Garcia-Mozo, H. [2 ,3 ]
Alcazar, P. [2 ,3 ]
Perez-Badia, R. [5 ]
Cabezudo, B. [1 ]
Romero-Morte, J. [5 ]
Rojo, J. [5 ,6 ]
机构
[1] Univ Malaga, Dept Bot & Plant Physiol, Campus Teatinos S-N, E-29071 Malaga, Spain
[2] Univ Cordoba, Dept Bot Ecol & Plant Physiol, Agrifood Campus Int Excellence CeiA3, Cordoba, Spain
[3] Univ Cordoba, Andalusian Interuniv Inst Earth Syst IISTA, Cordoba, Spain
[4] Technol Univ Dublin, Sch Chem & Pharmaceut Sci, Dublin, Ireland
[5] Univ Castilla La Mancha, Inst Environm Sci Bot, Toledo, Spain
[6] Univ Complutense Madrid, Dept Pharmacol Pharmacognosy & Bot, Madrid, Spain
关键词
Missing data; Aerobiology; Time-series; Modelling; Interpolation; Environmental sampling; Bioaerosols; POACEAE POLLEN SEASON; AIRBORNE POLLEN; ALLERGENIC POLLEN; NATURAL PARK; IMPUTATION; START; PEAK; AIR; IDENTIFICATION; REQUIREMENTS;
D O I
10.1016/j.envres.2021.111391
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Missing data is a common problem in scientific research. The availability of extensive environmental time series is usually laborious and difficult, and sometimes unexpected failures are not detected until samples are processed. Consequently, environmental databases frequently have some gaps with missing data in it. Applying an interpolation method before starting the data analysis can be a good solution in order to complete this missing information. Nevertheless, there are several different approaches whose accuracy should be considered and compared. In this study, data from 6 aerobiological sampling stations were used as an example of environmental data series to assess the accuracy of different interpolation methods. For that, observed daily pollen/spore concentration data series were randomly removed, interpolated by using different methods and then, compared with the observed data to measure the errors produced. Different periods, gap sizes, interpolation methods and bioaerosols were considered in order to check their influence in the interpolation accuracy. The moving mean interpolation method obtained the highest success rate as average. By using this method, a success rate of the 70% was obtained when the risk classes used in the alert systems of the pollen information platforms were taken into account. In general, errors were mostly greater when there were high oscillations in the concentrations of biotic particles during consecutive days. That is the reason why the pre-peak and peak periods showed the highest interpolation errors. The errors were also higher when gaps longer than 5 days were considered. So, for completing long periods of missing data, it would be advisable to test other methodological approaches. A new Variation Index based on the behaviour of the pollen/spore season (measurement of the variability of the concentrations every 2 consecutive days) was elaborated, which allows to estimate the potential error before the interpolation is applied.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Comparative methods for handling missing data in large databases
    Henry, Antonia J.
    Hevelone, Nathanael D.
    Lipsitz, Stuart
    Nguyen, Louis L.
    JOURNAL OF VASCULAR SURGERY, 2013, 58 (05) : 1353 - +
  • [2] Statistical methods for interpolating missing meteorological data for use in building simulation
    Kasam, Alisha A.
    Lee, Benjamin D.
    Paredis, Christiaan J. J.
    BUILDING SIMULATION, 2014, 7 (05) : 455 - 465
  • [3] Statistical methods for interpolating missing meteorological data for use in building simulation
    Alisha A. Kasam
    Benjamin D. Lee
    Christiaan J. J. Paredis
    Building Simulation, 2014, 7 : 455 - 465
  • [4] Imputation of missing data in industrial databases
    Lakshminarayan, K
    Harp, SA
    Samad, T
    APPLIED INTELLIGENCE, 1999, 11 (03) : 259 - 275
  • [5] MISSING DATA IN LARGE ICU DATABASES
    Fialho, Andre
    Cismondi, Federico
    Vieira, Susana
    Sousa, Joao
    Reti, Shane
    Welsch, Roy
    Howell, Michael
    Finkelstein, Stan
    CRITICAL CARE MEDICINE, 2010, 38 (12) : U6 - U6
  • [6] Imputation of Missing Data in Industrial Databases
    Kamakshi Lakshminarayan
    Steven A. Harp
    Tariq Samad
    Applied Intelligence, 1999, 11 : 259 - 275
  • [7] The problem of missing data in geoscience databases
    Henley, Stephen
    COMPUTERS & GEOSCIENCES, 2006, 32 (09) : 1368 - 1377
  • [8] COMPARISON OF METHODS FOR INTERPOLATING OCEANOGRAPHIC DATA
    BORKOWSKI, MR
    GOULET, JR
    DEEP-SEA RESEARCH, 1971, 18 (02): : 269 - +
  • [9] The roles of nearest neighbor methods in imputing missing data in forest inventory and monitoring databases
    Eskelson, Bianca N. I.
    Temesgen, Hailemariam
    Lemay, Valerie
    Barrett, Tara M.
    Crookston, Nicholas L.
    Hudak, Andrew T.
    SCANDINAVIAN JOURNAL OF FOREST RESEARCH, 2009, 24 (03) : 235 - 246
  • [10] Experimental analysis of methods for imputation of missing values in databases
    Farhangfar, A
    Kurgan, L
    Pedrycz, W
    INTELLIGENT COMPUTING: THEORY AND APPLICATIONS II, 2004, 5421 : 172 - 182