Dealing with large particle counting data sets

被引:1
|
作者
Ceronio, AD [1 ]
Haarhoff, J [1 ]
机构
[1] Rand Afrikaans Univ, ZA-2006 Auckland Pk, South Africa
来源
关键词
data management; data reduction; particle counting; power law;
D O I
10.2166/ws.2002.0147
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
A particle count survey of 21 South African water treatment plants over a period of 15 months presented the authors with challenges similar to those experienced by other workers in the field. The amount of data generated was staggering and had to be dealt with in an. orderly and structured way to derive the maximum benefit from the survey. Furthermore, the number of significant data points involved if the entire count is to be taken into consideration complicated interpretation of particle counting data. This led to the application of several data reduction techniques to reduce the number of significant parameters that had to be considered during analysis. The most common conventional method is the use of the total particle count larger than a given size, for example total count per ml > 2 mum. This method, however, negates one of the most powerful abilities of the particle counter, namely the ability to indicate particle size distribution. The application of the power law, a common alternative, provides a more detailed description but has its flaws. In this paper the authors illustrate how many particle counts were successfully handled in a purpose-designed database and how the power law concept was improved to provide a better particle counting data-reduction methodology.
引用
收藏
页码:35 / 40
页数:6
相关论文
共 50 条
  • [21] Sets, bags, and rock and roll - Analyzing large data sets of network data
    McHugh, J
    COMPUTER SECURITY ESORICS 2004, PROCEEDINGS, 2004, 3193 : 407 - 422
  • [22] Quantitative analysis of SILAC data sets using spectral counting
    Parker, Sarah J.
    Halligan, Brian D.
    Greene, Andrew S.
    PROTEOMICS, 2010, 10 (07) : 1408 - 1415
  • [23] The Promise of Large, Longitudinal Data Sets
    Valenstein, Marcia
    PSYCHIATRIC SERVICES, 2013, 64 (06) : 503 - 503
  • [24] Parallel visualization of large data sets
    Rosenberg, R
    Lanzagorta, M
    Chtchelkanova, A
    Khokhlov, A
    VISUAL DATA EXPLORATION AND ANALYSIS VII, 2000, 3960 : 135 - 143
  • [25] Managing and Analyzing Large Data Sets
    Snyder, Derrick
    Burress, Brian
    2011 FUTURE OF INSTRUMENTATION INTERNATIONAL WORKSHOP (FIIW), 2011,
  • [26] Efficient clustering of large data sets
    Ananthanarayana, VS
    Murty, MN
    Subramanian, DK
    PATTERN RECOGNITION, 2001, 34 (12) : 2561 - 2563
  • [27] Knowledge Discovery in Large Data Sets
    Simas, Tiago
    Silva, Gabriel
    Miranda, Bruno
    Moitinho, Andre
    Ribeiro, Rita
    CLASSIFICATION AND DISCOVERY IN LARGE ASTRONOMICAL SURVEYS, 2008, 1082 : 196 - +
  • [28] Modeling large data sets in marketing
    Balasubramanian, S
    Gupta, S
    Kamakura, W
    Wedel, M
    STATISTICA NEERLANDICA, 1998, 52 (03) : 303 - 323
  • [29] Visualizations for browsing in large data sets
    Roberts, John
    Lank, Edward
    Gemmell, Jim
    PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION, 2005, : 25 - 30
  • [30] Visual exploration of large data sets
    Keim, Daniel A.
    2001, Association for Computing Machinery (44)