Methods for interpolating missing data in aerobiological databases

被引:24
|
作者
Picornell, A. [1 ]
Oteros, J. [2 ,3 ]
Ruiz-Mata, R. [1 ]
Recio, M. [1 ]
Trigo, M. M. [1 ]
Martinez-Bracero, M. [2 ,3 ,4 ]
Lara, B. [5 ]
Serrano-Garcia, A. [5 ]
Galan, C. [2 ,3 ]
Garcia-Mozo, H. [2 ,3 ]
Alcazar, P. [2 ,3 ]
Perez-Badia, R. [5 ]
Cabezudo, B. [1 ]
Romero-Morte, J. [5 ]
Rojo, J. [5 ,6 ]
机构
[1] Univ Malaga, Dept Bot & Plant Physiol, Campus Teatinos S-N, E-29071 Malaga, Spain
[2] Univ Cordoba, Dept Bot Ecol & Plant Physiol, Agrifood Campus Int Excellence CeiA3, Cordoba, Spain
[3] Univ Cordoba, Andalusian Interuniv Inst Earth Syst IISTA, Cordoba, Spain
[4] Technol Univ Dublin, Sch Chem & Pharmaceut Sci, Dublin, Ireland
[5] Univ Castilla La Mancha, Inst Environm Sci Bot, Toledo, Spain
[6] Univ Complutense Madrid, Dept Pharmacol Pharmacognosy & Bot, Madrid, Spain
关键词
Missing data; Aerobiology; Time-series; Modelling; Interpolation; Environmental sampling; Bioaerosols; POACEAE POLLEN SEASON; AIRBORNE POLLEN; ALLERGENIC POLLEN; NATURAL PARK; IMPUTATION; START; PEAK; AIR; IDENTIFICATION; REQUIREMENTS;
D O I
10.1016/j.envres.2021.111391
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Missing data is a common problem in scientific research. The availability of extensive environmental time series is usually laborious and difficult, and sometimes unexpected failures are not detected until samples are processed. Consequently, environmental databases frequently have some gaps with missing data in it. Applying an interpolation method before starting the data analysis can be a good solution in order to complete this missing information. Nevertheless, there are several different approaches whose accuracy should be considered and compared. In this study, data from 6 aerobiological sampling stations were used as an example of environmental data series to assess the accuracy of different interpolation methods. For that, observed daily pollen/spore concentration data series were randomly removed, interpolated by using different methods and then, compared with the observed data to measure the errors produced. Different periods, gap sizes, interpolation methods and bioaerosols were considered in order to check their influence in the interpolation accuracy. The moving mean interpolation method obtained the highest success rate as average. By using this method, a success rate of the 70% was obtained when the risk classes used in the alert systems of the pollen information platforms were taken into account. In general, errors were mostly greater when there were high oscillations in the concentrations of biotic particles during consecutive days. That is the reason why the pre-peak and peak periods showed the highest interpolation errors. The errors were also higher when gaps longer than 5 days were considered. So, for completing long periods of missing data, it would be advisable to test other methodological approaches. A new Variation Index based on the behaviour of the pollen/spore season (measurement of the variability of the concentrations every 2 consecutive days) was elaborated, which allows to estimate the potential error before the interpolation is applied.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Methods for Mediation Analysis with Missing Data
    Zhang, Zhiyong
    Wang, Lijuan
    PSYCHOMETRIKA, 2013, 78 (01) : 154 - 184
  • [32] Rank correlation methods for missing data
    Alvo, M
    Cabilio, P
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1995, 23 (04): : 345 - 358
  • [33] Simple methods to handle missing data
    Bici, Ruzhdie
    INTERNATIONAL JOURNAL OF COMPUTATIONAL ECONOMICS AND ECONOMETRICS, 2023, 13 (02) : 216 - 242
  • [34] Comparing Methods for Handling Missing Data
    Roda, Celina
    Nicolis, Ioannis
    Momas, Isabelle
    Guihenneuc-Jouyaux, Chantal
    EPIDEMIOLOGY, 2013, 24 (03) : 469 - 471
  • [35] Techniques for missing value recovering in imbalanced databases:: application in a marketing database with massive missing data
    Zarate, Luis E.
    Nogueira, Bruno M.
    Santos, Tadeu R. A.
    Song, Mark A. J.
    2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 2658 - +
  • [36] Imputing missing genotypes: effects of methods and patterns of missing data
    Funda Ogut
    Fikret Isik
    Steven McKeand
    Ross Whetten
    BMC Proceedings, 5 (Suppl 7)
  • [37] AEROBIOLOGICAL SAMPLING METHODS FROM AIRCRAFT
    KELLY, CD
    PADY, SM
    POLUNIN, N
    CANADIAN JOURNAL OF BOTANY-REVUE CANADIENNE DE BOTANIQUE, 1951, 29 (03): : 206 - 214
  • [38] A study of handling missing data methods for big data
    Ezzine, Imane
    Benhlima, Laila
    2018 IEEE 5TH INTERNATIONAL CONGRESS ON INFORMATION SCIENCE AND TECHNOLOGY (IEEE CIST'18), 2018, : 498 - 501
  • [39] INTERPOLATING MISSING VALUES IN A TIME-SERIES
    DAMSLETH, E
    SCANDINAVIAN JOURNAL OF STATISTICS, 1980, 7 (01) : 33 - 39
  • [40] Data extraction methods in medium and large databases
    Dymond, AM
    PROCEEDINGS OF THE TWENTY-THIRD ANNUAL SAS USERS GROUP INTERNATIONAL CONFERENCE, 1998, : 505 - 510