A simple decomposition method for support vector machines

被引:224
|
作者
Hsu, CW [1 ]
Lin, CJ [1 ]
机构
[1] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
关键词
support vector machines; decomposition methods; classification;
D O I
10.1023/A:1012427100071
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The decomposition method is currently one of the major methods for solving support vector machines. An important issue of this method is the selection of working sets. In this paper through the design of decomposition methods for bound-constrained SVM formulations we demonstrate that the working set selection is not a trivial task. Then from the experimental analysis we propose a simple selection of the working set which leads to faster convergences for difficult cases. Numerical experiments on different types of problems are conducted to demonstrate the viability of the proposed method.
引用
收藏
页码:291 / 314
页数:24
相关论文
共 50 条
  • [1] A Simple Decomposition Method for Support Vector Machines
    Chih-Wei Hsu
    Chih-Jen Lin
    Machine Learning, 2002, 46 : 291 - 314
  • [2] On the convergence of the decomposition method for support vector machines
    Lin, CJ
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (06): : 1288 - 1298
  • [3] Improved decomposition method for support vector machines
    Zhou, WD
    Zhang, L
    Jiao, LC
    ICCIMA 2003: FIFTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND MULTIMEDIA APPLICATIONS, PROCEEDINGS, 2003, : 32 - 36
  • [4] A new momentum minimization decomposition method for Support Vector Machines
    Lai, D
    Mani, N
    Palaniswami, M
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 2001 - 2006
  • [5] A new decomposition method for support vector machines with polynomial convergence
    Qiao, Hong
    Wang, Yan-Guo
    Zhang, Bo
    ICCSE'2006: Proceedings of the First International Conference on Computer Science & Education: ADVANCED COMPUTER TECHNOLOGY, NEW EDUCATION, 2006, : 131 - 134
  • [6] Stability analysis of the decomposition method for solving Support Vector Machines
    Lai, D
    Shilton, A
    Mani, N
    Palaniswami, M
    2005 INTERNATIONAL CONFERENCE ON INTELLIGENT SENSING AND INFORMATION PROCESSING, PROCEEDINGS, 2005, : 272 - 277
  • [7] A simple decomposition algorithm for support vector machines with polynomial-time convergence
    Qiao, Hong
    Wang, Yan-Guo
    Zhang, Bo
    PATTERN RECOGNITION, 2007, 40 (09) : 2543 - 2549
  • [8] A dynamic system framework for the decomposition method solving Support Vector Machines
    Lai, D
    Mani, N
    Palaniswami, M
    PROCEEDINGS OF THE 2004 INTELLIGENT SENSORS, SENSOR NETWORKS & INFORMATION PROCESSING CONFERENCE, 2004, : 283 - 288
  • [9] Decomposition methods for linear support vector machines
    Chung, KM
    Kao, WC
    Sun, T
    Lin, CJ
    2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PROCEEDINGS: SIGNAL PROCESSING FOR COMMUNICATIONS SPECIAL SESSIONS, 2003, : 868 - 871
  • [10] Decomposition methods for linear support vector machines
    Kao, WC
    Chung, KM
    Sun, CL
    Lin, CJ
    NEURAL COMPUTATION, 2004, 16 (08) : 1689 - 1704