Scaling Up Support Vector Machines Using Nearest Neighbor Condensation

被引:33
|
作者
Angiulli, Fabrizio [1 ]
Astorino, Annabella [2 ]
机构
[1] Univ Calabria, Dept Elect Comp Sci & Syst Engn, I-87036 Arcavacata Di Rende, CS, Italy
[2] CNR, Inst High Performance Networking & Comp, I-87036 Arcavacata Di Rende, CS, Italy
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2010年 / 21卷 / 02期
关键词
Support vector machines; Training; Accuracy; Kernel; Nearest neighbor searches; Data mining; Clustering algorithms; support vector machines (SVMs); Classification; large data sets; training-set condensation; nearest neighbor rule;
D O I
10.1109/TNN.2009.2039227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this brief, we describe the FCNN-SVM classifier, which combines the support vector machine (SVM) approach and the fast nearest neighbor condensation classification rule (FCNN) in order to make SVMs practical on large collections of data. As a main contribution, it is experimentally shown that, on very large and multidimensional data sets, the FCNN-SVM is one or two orders of magnitude faster than SVM, and that the number of support vectors (SVs) is more than halved with respect to SVM. Thus, a drastic reduction of both training and testing time is achieved by using the FCNN-SVM. This result is obtained at the expense of a little loss of accuracy. The FCNN-SVM is proposed as a viable alternative to the standard SVM in applications where a fast response time is a fundamental requirement. © 2009 IEEE.
引用
收藏
页码:351 / 357
页数:7
相关论文
共 50 条
  • [31] The effect of attribute scaling on the performance of support vector machines
    Edwards, C
    Raskutti, B
    AI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2004, 3339 : 500 - 512
  • [32] A Comparative Assessment of Support Vector Machines, Probabilistic Neural Networks, and K-Nearest Neighbor Algorithms for Water Quality Classification
    Modaresi, Fereshteh
    Araghinejad, Shahab
    WATER RESOURCES MANAGEMENT, 2014, 28 (12) : 4095 - 4111
  • [33] A Comparative Assessment of Support Vector Machines, Probabilistic Neural Networks, and K-Nearest Neighbor Algorithms for Water Quality Classification
    Fereshteh Modaresi
    Shahab Araghinejad
    Water Resources Management, 2014, 28 : 4095 - 4111
  • [34] On nearest-neighbor error-correcting output codes with application to all-pairs multiclass support vector machines
    Klautau, A
    Jevtic, N
    Orlitsky, A
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 4 (01) : 1 - 15
  • [35] Refined Lower Bounds for Nearest Neighbor Condensation
    Chitnis, Rajesh
    INTERNATIONAL CONFERENCE ON ALGORITHMIC LEARNING THEORY, VOL 167, 2022, 167
  • [36] Anode Effect Prediction Based on Support Vector Machine and K Nearest Neighbor
    Zhou, Kaibo
    Xu, Gaofeng
    Guo, Sihai
    2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 341 - 345
  • [37] K-nearest neighbor based structural twin support vector machine
    Pan, Xianli
    Luo, Yao
    Xu, Yitian
    KNOWLEDGE-BASED SYSTEMS, 2015, 88 : 34 - 44
  • [38] Guarantees on nearest-neighbor condensation heuristics
    Flores-Velazco, Alejandro
    Mount, David
    COMPUTATIONAL GEOMETRY-THEORY AND APPLICATIONS, 2021, 95
  • [39] Improvements to Bennett's nearest point algorithm for support vector machines
    Li, JM
    Zhang, JW
    Zhang, B
    Lin, FZ
    ADVANCES IN NEURAL NETWORKS - ISNN 2004, PT 1, 2004, 3173 : 462 - 467
  • [40] Comparison of Fuzzy Robust Kernel C-Means and Support Vector Machines for Intrusion Detection Systems Using Modified Kernel Nearest Neighbor Feature Selection
    Rustam, Z.
    Olivera, N.
    PROCEEDINGS OF THE 3RD INTERNATIONAL SYMPOSIUM ON CURRENT PROGRESS IN MATHEMATICS AND SCIENCES 2017 (ISCPMS2017), 2018, 2023