Normalizing variables with too-frequent values using a Kolmogorov-Smirnov test: A practical approach

被引:24
|
作者
Drezner, Zvi [1 ]
Turel, Ofir [1 ]
机构
[1] Calif State Univ Fullerton, Steven G Mihaylo Coll Business & Econ, Fullerton, CA 92834 USA
关键词
Normal distribution; Normalizing data; Kolmogorov-Smirnov; Too-frequent data; MULTIVARIATE NORMALITY;
D O I
10.1016/j.cie.2011.07.015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Many quantitative applications in business operations, environmental engineering, and production assume sufficient normality of data, which is often, demonstrated using tests of normality, such as the Kolmogorov deemed Smirnov test. A practical problem arises when a high proportion of a too-frequent value exists in data, in which case transformation to normality that passes tests for normality may be impossible. Analysts and researchers are therefore often concerned with the question: should we bother transforming the variable to normality? Or should we revert to other approaches not requiring a normal distribution? In this study, we find the critical number of the frequency of a single value for which there is no feasible transformation to normality within a given a of the Kolmogorov-Smirnov test. The resultant decision table can guide the effort of analysts and researchers. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1240 / 1244
页数:5
相关论文
共 38 条
  • [11] Compressed Medical Image Quality Determination Using the Kolmogorov-Smirnov Test
    Chen, Tzong-Jer
    Chuang, Keh-Shih
    Wu, Wei
    Lu, Yue-Ran
    CURRENT MEDICAL IMAGING REVIEWS, 2017, 13 (02) : 204 - 209
  • [12] Validation of Bayesian posterior distributions using a multidimensional Kolmogorov-Smirnov test
    Harrison, Diana
    Sutton, David
    Carvalho, Pedro
    Hobson, Michael
    MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2015, 451 (03) : 2610 - 2624
  • [13] Improved stereo correlation using Moravec operator and Kolmogorov-Smirnov test
    Chowdhury, AS
    Arabnia, HR
    Bandyopadhyay, D
    VISION '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON COMPUTER VISION, 2005, : 24 - 30
  • [14] Diagnosing problems with imputation models using the Kolmogorov-Smirnov test: a simulation study
    Nguyen, Cattram D.
    Carlin, John B.
    Lee, Katherine J.
    BMC MEDICAL RESEARCH METHODOLOGY, 2013, 13
  • [15] Fast Unsupervised Online Drift Detection Using Incremental Kolmogorov-Smirnov Test
    dos Reis, Denis
    Flach, Peter
    Matwin, Stan
    Batista, Gustavo
    KDD'16: PROCEEDINGS OF THE 22ND ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2016, : 1545 - 1554
  • [16] Revisiting the critical values of the Lilliefors test: towards the correct agrometeorological use of the Kolmogorov-Smirnov framework
    Blain, Gabriel Constantino
    BRAGANTIA, 2014, 73 (02) : 192 - 202
  • [17] Diagnosing problems with imputation models using the Kolmogorov-Smirnov test: a simulation study
    Cattram D Nguyen
    John B Carlin
    Katherine J Lee
    BMC Medical Research Methodology, 13
  • [18] A Statistical Approach of Analog Circuit Fault Detection Utilizing Kolmogorov-Smirnov Test Method
    Srimani, Supriyo
    Parai, Manas
    Ghosh, Kasturi
    Rahaman, Hafizur
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2021, 40 (05) : 2091 - 2113
  • [19] Classifying speech sonority functional data using a projected Kolmogorov-Smirnov approach
    Antonio Cuesta-Albertos, Juan
    Fraiman, Ricardo
    Galves, Antonio
    Garcia, Jesus
    Svarc, Marcela
    JOURNAL OF APPLIED STATISTICS, 2007, 34 (06) : 749 - 761
  • [20] Generic Side-channel Distinguisher Based on Kolmogorov-Smirnov Test: Explicit Construction and Practical Evaluation
    Liu Jiye
    Zhou Yongbin
    Yang Shuguo
    Feng Dengguo
    CHINESE JOURNAL OF ELECTRONICS, 2012, 21 (03): : 547 - 553