Dealing with large particle counting data sets

被引:1
|
作者
Ceronio, AD [1 ]
Haarhoff, J [1 ]
机构
[1] Rand Afrikaans Univ, ZA-2006 Auckland Pk, South Africa
来源
关键词
data management; data reduction; particle counting; power law;
D O I
10.2166/ws.2002.0147
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
A particle count survey of 21 South African water treatment plants over a period of 15 months presented the authors with challenges similar to those experienced by other workers in the field. The amount of data generated was staggering and had to be dealt with in an. orderly and structured way to derive the maximum benefit from the survey. Furthermore, the number of significant data points involved if the entire count is to be taken into consideration complicated interpretation of particle counting data. This led to the application of several data reduction techniques to reduce the number of significant parameters that had to be considered during analysis. The most common conventional method is the use of the total particle count larger than a given size, for example total count per ml > 2 mum. This method, however, negates one of the most powerful abilities of the particle counter, namely the ability to indicate particle size distribution. The application of the power law, a common alternative, provides a more detailed description but has its flaws. In this paper the authors illustrate how many particle counts were successfully handled in a purpose-designed database and how the power law concept was improved to provide a better particle counting data-reduction methodology.
引用
收藏
页码:35 / 40
页数:6
相关论文
共 50 条
  • [41] Engineering Algorithms for Large Data Sets
    Sanders, Peter
    SOFSEM 2013: Theory and Practice of Computer Science, 2013, 7741 : 29 - 32
  • [42] Visualizing large telecommunication data sets
    Koutsofios, EE
    North, SE
    Keim, DA
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 1999, 19 (03) : 16 - 19
  • [43] Visual exploration of large data sets
    Livny, M
    Ramakrishnan, R
    Myllymaki, J
    HUMAN VISION AND ELECTRONIC IMAGING, 1996, 2657 : 263 - 274
  • [44] Interactive Visualization of Large Data Sets
    Godfrey, Parke
    Gryz, Jarek
    Lasek, Piotr
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (08) : 2142 - 2157
  • [45] Vertex counting: Statistical distribution of vertices in large sets of tree diagrams
    P. Draggiotis
    R. Kleiss
    The European Physical Journal C - Particles and Fields, 2003, 27 : 291 - 296
  • [46] Vertex counting: Statistical distribution of vertices in large sets of tree diagrams
    Draggiotis, P
    Kleiss, R
    EUROPEAN PHYSICAL JOURNAL C, 2003, 27 (02): : 291 - 296
  • [47] Particle swarm classifier for fuzzy data sets
    Shahraki, Hadi
    Zahiri, Seyed-Hamid
    2015 INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2015, : 295 - 299
  • [48] Data mining from extreme data sets: Very large and/or very skewed data sets
    Hall, LO
    2001 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: E-SYSTEMS AND E-MAN FOR CYBERNETICS IN CYBERSPACE, 2002, : 2555 - 2555
  • [49] Visual data mining of large spatial data sets
    Keim, DA
    Panse, C
    Sips, M
    DATABASES IN NETWORKED INFORMATION SYSTEMS, PROCEEDINGS, 2003, 2822 : 201 - 215
  • [50] Nonparametric analysis of fingerprint data on large data sets
    Wu, Jin Chu
    Wilson, Charles L.
    PATTERN RECOGNITION, 2007, 40 (09) : 2574 - 2584