Reproducibility and imputation of air toxics data

被引:12
|
作者
Le, Hien Q.
Batterman, Stuart A. [1 ]
Wahl, Robert L.
机构
[1] Univ Michigan, Ann Arbor, MI 48109 USA
[2] Michigan Dept Community Hlth, Ann Arbor, MI 48109 USA
来源
JOURNAL OF ENVIRONMENTAL MONITORING | 2007年 / 9卷 / 12期
关键词
D O I
10.1039/b709816b
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Ambient air quality datasets include missing data, values below method detection limits and outliers, and the precision and accuracy of the measurements themselves are often unknown. At the same time, many analyses require continuous data sequences and assume that measurements are error-free. While a variety of data imputation and cleaning techniques are available, the evaluation of such techniques remains limited. This study evaluates the performance of these techniques for ambient air toxics measurements, a particularly challenging application, and includes the analysis of intra- and inter-laboratory precision. The analysis uses an unusually complete-dataset, consisting of daily measurements of over 70 species of carbonyls and volatile organic compounds ( VOCs) collected over a one year period in Dearborn, Michigan, including 122 pairs of replicates. Analysis was restricted to compounds found above detection limits in >= 20% of the samples. Outliers were detected using the Gumbell extreme value distribution. Error models for inter- and intra-laboratory reproducibility were derived from replicate samples. Imputation variables were selected using a generalized additive model, and the performance of two techniques, multiple imputation and optimal linear estimation, was evaluated for three missingness patterns. Many species were rarely detected or had very poor reproducibility. Error models developed for seven carbonyls showed median intra- and inter- laboratory errors of 22% and 25%, respectively. Better reproducibility was seen for the 16 VOCs meeting detection and reproducibility criteria. Imputation performance depended on the compound and missingness pattern. Data missing at random could be adequately imputed, but imputations for row-wise deletions, the most common type of missingness pattern encountered, were not informative. The analysis shows that air toxics data require significant efforts to identify and mitigate errors, outliers and missing observations, and that these steps are essential and should be performed prior to using these data in receptor, exposure, health and other applications.
引用
收藏
页码:1358 / 1372
页数:15
相关论文
共 50 条
  • [1] A comparison of multiple imputation and optimal estimation for missing and uncertain urban air toxics data
    Le, H.
    Batterman, S.
    Dombrowski, K.
    Wahl, R.
    Wirth, J.
    Wasilevich, E.
    Depa, M.
    EPIDEMIOLOGY, 2006, 17 (06) : S242 - S242
  • [2] AIR TOXICS
    BECK, EC
    ENVIRONMENTAL SCIENCE & TECHNOLOGY, 1987, 21 (11) : 1055 - 1055
  • [3] Spatial and temporal variability of ambient air toxics data
    Touma, Jawad S.
    Cox, William M.
    Tikvart, Joseph A.
    JOURNAL OF THE AIR & WASTE MANAGEMENT ASSOCIATION, 2006, 56 (12) : 1716 - 1725
  • [4] Clustering Imputation for Air Pollution Data
    Alahamade, Wedad
    Lake, Iain
    Reeves, Claire E.
    De la Iglesia, Beatriz
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, HAIS 2020, 2020, 12344 : 585 - 597
  • [5] AIR TOXICS
    BERRY, DK
    ENVIRONMENTAL SCIENCE & TECHNOLOGY, 1986, 20 (07) : 647 - 651
  • [6] AIR TOXICS
    FELDSTEIN, M
    JAPCA-THE INTERNATIONAL JOURNAL OF AIR POLLUTION CONTROL AND HAZARDOUS WASTE MANAGEMENT, 1987, 37 (12): : 1385 - 1385
  • [7] Sources of variability in ambient air toxics monitoring data
    Bortnick, SM
    Stetzer, SL
    ATMOSPHERIC ENVIRONMENT, 2002, 36 (11) : 1783 - 1791
  • [8] AIR TOXICS UPDATE
    HUNT, GT
    EGAN, BA
    POLLUTION ENGINEERING, 1985, 17 (06) : 46 - 52
  • [9] REGULATING AIR TOXICS
    DOWD, RM
    ENVIRONMENTAL SCIENCE & TECHNOLOGY, 1983, 17 (12) : A571 - A571
  • [10] Air toxics in ambient air of Delhi
    Srivastava, A
    Joseph, AE
    Patil, S
    More, A
    Dixit, RC
    Prakash, M
    ATMOSPHERIC ENVIRONMENT, 2005, 39 (01) : 59 - 71