On optimum choice of k in nearest neighbor classification

被引：85
|
作者：
Ghosh, Anil K. [1 ]
机构：
[1] Indian Stat Inst, Theoret Stat & Math Unit, Kolkata 700108, India
来源：
COMPUTATIONAL STATISTICS & DATA ANALYSIS | 2006年 / 50卷 / 11期
关键词：
accuracy index; Bayesian strength function; cross-validation; misclassification rate; neighborhood parameter; non-informative prior; optimal Bayes risk; posterior probability;
D O I：
10.1016/j.csda.2005.06.007
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
A major issue in k-nearest neighbor classification is how to choose the optimum value of the neighborhood parameter k. Popular cross-validation techniques often fail to guide us well in selecting k mainly due to the presence of multiple minimizers of the estimated misclassification rate. This article investigates a Bayesian method in this connection, which solves the problem of multiple optimizers. The utility of the proposed method is illustrated using some benchmark data sets. (C) 2005 Elsevier B.V. All rights reserved.
引用
收藏
页码：3113 / 3123
页数：11
相关论文
共 50 条
  • [21] An Improved K-Nearest Neighbor Algorithm for Pattern Classification
    Sultana, Zinnia
    Ferdousi, Ashifatul
    Tasnim, Farzana
    Nahar, Lutfun
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 760 - 767
  • [22] Using k-nearest-neighbor classification in the leaves of a tree
    Buttrey, SE
    Karo, C
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2002, 40 (01) : 27 - 37
  • [23] IKNN: Informative K-nearest neighbor pattern classification
    Song, Yan
    Huang, Jian
    Zhou, Ding
    Zha, Hongyuan
    Giles, C. Lee
    KNOWLEDGE DISCOVERY IN DATABASES: PKDD 2007, PROCEEDINGS, 2007, 4702 : 248 - +
  • [24] Improving K-Nearest Neighbor Efficacy for FarsiText Classification
    Elahimanesh, Mohammad Hossein
    BehrouzMinaei-Bidgoli
    Malekinezhad, Hossein
    LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2012, : 1618 - 1621
  • [25] Nearest Neighbor Classification Using Bottom-k Sketches
    Dahlgaard, Soren
    Igel, Christian
    Thorup, Mikkel
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [26] Improving k Nearest Neighbor with Exemplar Generalization for Imbalanced Classification
    Li, Yuxuan
    Zhang, Xiuzhen
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT II: 15TH PACIFIC-ASIA CONFERENCE, PAKDD 2011, 2011, 6635 : 321 - 332
  • [27] A fuzzy-evidential k nearest neighbor classification algorithm
    Du, N. (duni1024@sina.cn), 2012, Chinese Institute of Electronics (40):
  • [28] Rate of Convergence of k-Nearest-Neighbor Classification Rule
    Doering, Maik
    Gyorfi, Laszlo
    Walk, Harro
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 18
  • [29] Style linear k-nearest neighbor classification method
    Zhang, Jin
    Bian, Zekang
    Wang, Shitong
    APPLIED SOFT COMPUTING, 2024, 150
  • [30] Distributed and Joint Evidential K-Nearest Neighbor Classification
    Gong, Chaoyu
    Demmel, Jim
    You, Yang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 5972 - 5985
12345