Methods for interpolating missing data in aerobiological databases

被引:24
|
作者
Picornell, A. [1 ]
Oteros, J. [2 ,3 ]
Ruiz-Mata, R. [1 ]
Recio, M. [1 ]
Trigo, M. M. [1 ]
Martinez-Bracero, M. [2 ,3 ,4 ]
Lara, B. [5 ]
Serrano-Garcia, A. [5 ]
Galan, C. [2 ,3 ]
Garcia-Mozo, H. [2 ,3 ]
Alcazar, P. [2 ,3 ]
Perez-Badia, R. [5 ]
Cabezudo, B. [1 ]
Romero-Morte, J. [5 ]
Rojo, J. [5 ,6 ]
机构
[1] Univ Malaga, Dept Bot & Plant Physiol, Campus Teatinos S-N, E-29071 Malaga, Spain
[2] Univ Cordoba, Dept Bot Ecol & Plant Physiol, Agrifood Campus Int Excellence CeiA3, Cordoba, Spain
[3] Univ Cordoba, Andalusian Interuniv Inst Earth Syst IISTA, Cordoba, Spain
[4] Technol Univ Dublin, Sch Chem & Pharmaceut Sci, Dublin, Ireland
[5] Univ Castilla La Mancha, Inst Environm Sci Bot, Toledo, Spain
[6] Univ Complutense Madrid, Dept Pharmacol Pharmacognosy & Bot, Madrid, Spain
关键词
Missing data; Aerobiology; Time-series; Modelling; Interpolation; Environmental sampling; Bioaerosols; POACEAE POLLEN SEASON; AIRBORNE POLLEN; ALLERGENIC POLLEN; NATURAL PARK; IMPUTATION; START; PEAK; AIR; IDENTIFICATION; REQUIREMENTS;
D O I
10.1016/j.envres.2021.111391
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Missing data is a common problem in scientific research. The availability of extensive environmental time series is usually laborious and difficult, and sometimes unexpected failures are not detected until samples are processed. Consequently, environmental databases frequently have some gaps with missing data in it. Applying an interpolation method before starting the data analysis can be a good solution in order to complete this missing information. Nevertheless, there are several different approaches whose accuracy should be considered and compared. In this study, data from 6 aerobiological sampling stations were used as an example of environmental data series to assess the accuracy of different interpolation methods. For that, observed daily pollen/spore concentration data series were randomly removed, interpolated by using different methods and then, compared with the observed data to measure the errors produced. Different periods, gap sizes, interpolation methods and bioaerosols were considered in order to check their influence in the interpolation accuracy. The moving mean interpolation method obtained the highest success rate as average. By using this method, a success rate of the 70% was obtained when the risk classes used in the alert systems of the pollen information platforms were taken into account. In general, errors were mostly greater when there were high oscillations in the concentrations of biotic particles during consecutive days. That is the reason why the pre-peak and peak periods showed the highest interpolation errors. The errors were also higher when gaps longer than 5 days were considered. So, for completing long periods of missing data, it would be advisable to test other methodological approaches. A new Variation Index based on the behaviour of the pollen/spore season (measurement of the variability of the concentrations every 2 consecutive days) was elaborated, which allows to estimate the potential error before the interpolation is applied.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Handling of missing data to improve the mining of large feed databases
    Maroto-Molina, F.
    Gomez-Cabrera, A.
    Guerrero-Ginel, J. E.
    Garrido-Varo, A.
    Sauvant, D.
    Tran, G.
    Heuze, V.
    Perez-Marin, D. C.
    JOURNAL OF ANIMAL SCIENCE, 2013, 91 (01) : 491 - 500
  • [22] A missing data estimation analysis in Type II diabetes databases
    Giardina, M
    Huo, Y
    Azuaje, F
    McCullagh, P
    Harper, R
    18th IEEE Symposium on Computer-Based Medical Systems, Proceedings, 2005, : 347 - 352
  • [24] Missing Data in Primary Care Databases; Problems and a Possible Solution
    Marston, Louise
    Carpenter, James
    Walters, Kate
    Morris, Richard
    Nazareth, Irwin
    Petersen, Irene
    PHARMACOEPIDEMIOLOGY AND DRUG SAFETY, 2010, 19 : S88 - S88
  • [25] A heuristic approach to handling missing data in biologics manufacturing databases
    Mante, Jeanet
    Gangadharan, Nishanthi
    Sewell, David J.
    Turner, Richard
    Field, Ray
    Oliver, Stephen G.
    Slater, Nigel
    Dikicioglu, Duygu
    BIOPROCESS AND BIOSYSTEMS ENGINEERING, 2019, 42 (04) : 657 - 663
  • [26] Comparison of methods for interpolating soil properties using limited data
    Schloeder, CA
    Zimmerman, NE
    Jacobs, MJ
    SOIL SCIENCE SOCIETY OF AMERICA JOURNAL, 2001, 65 (02) : 470 - 479
  • [27] Principled missing data methods for researchers
    Dong, Yiran
    Peng, Chao-Ying Joanne
    SPRINGERPLUS, 2013, 2 : 1 - 17
  • [28] Methods for Mediation Analysis with Missing Data
    Zhiyong Zhang
    Lijuan Wang
    Psychometrika, 2013, 78 : 154 - 184
  • [29] Methods for Missing Data in Competing Risks
    Bonneville, E. F.
    Resche-Rigon, M.
    de Wreede, L. C.
    Putter, H.
    BONE MARROW TRANSPLANTATION, 2020, 55 (SUPPL 1) : 179 - 180
  • [30] Missing data: Issues, concepts, methods
    Pham, Tra My
    Pandis, Nikolaos
    White, Ian R.
    SEMINARS IN ORTHODONTICS, 2024, 30 (01) : 37 - 44