Principal weighted support vector machines for sufficient dimension reduction in binary classification

被引:31
|
作者
Shin, Seung Jun [1 ]
Wu, Yichao [2 ]
Zhang, Hao Helen [3 ]
Liu, Yufeng [4 ]
机构
[1] Korea Univ, Dept Stat, Seoul 02841, South Korea
[2] North Carolina State Univ, Dept Stat, 2311 Stinson Dr,Campus Box 8203, Raleigh, NC 27695 USA
[3] Univ Arizona, Dept Math, 617 North Santa Rita Ave,POB 210089, Tucson, AZ 85721 USA
[4] Univ North Carolina Chapel Hill, Dept Stat & Operat Res, 354 Hanes Hall, Chapel Hill, NC 27599 USA
基金
新加坡国家研究基金会; 美国国家卫生研究院; 美国国家科学基金会;
关键词
Fisher consistency; Hyperplane alignment; Reproducing kernel Hilbert space; Weighted support vector machine; SLICED INVERSE REGRESSION; CENTRAL SUBSPACE; HESSIAN DIRECTIONS;
D O I
10.1093/biomet/asw057
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sufficient dimension reduction is popular for reducing data dimensionality without stringent model assumptions. However, most existing methods may work poorly for binary classification. For example, sliced inverse regression (Li, 1991) can estimate at most one direction if the response is binary. In this paper we propose principal weighted support vector machines, a unified framework for linear and nonlinear sufficient dimension reduction in binary classification. Its asymptotic properties are studied, and an efficient computing algorithm is proposed. Numerical examples demonstrate its performance in binary classification.
引用
收藏
页码:67 / 81
页数:15
相关论文
共 50 条
  • [11] Principal minimax support vector machine for sufficient dimension reduction with contaminated data
    Zhou, Jingke
    Zhu, Lixing
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2016, 94 : 33 - 48
  • [12] A Forward Approach for Sufficient Dimension Reduction in Binary Classification
    Kang, Jongkyeong
    Shin, Seung Jun
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [13] A Forward Approach for Sufficient Dimension Reduction in Binary Classification
    Kang, Jongkyeong
    Shin, Seung Jun
    Journal of Machine Learning Research, 2022, 23
  • [14] Dimension Reduction using Evolutionary Support Vector Machines
    Ang, J. H.
    Teoh, E. J.
    Tan, C. H.
    Goh, K. C.
    Tan, K. C.
    2008 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-8, 2008, : 3634 - 3641
  • [15] Effect analysis of dimension reduction on support vector machines
    Zhu, MH
    Zhu, JB
    Chen, WL
    PROCEEDINGS OF THE 2005 IEEE INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND KNOWLEDGE ENGINEERING (IEEE NLP-KE'05), 2005, : 592 - 596
  • [16] Weighted Proximal Support Vector Machines: Robust Classification
    ZHANG Meng~1
    2. Academy of Microelectronics and Information Technology
    3. Department of Mathematics and Physics
    Wuhan University Journal of Natural Sciences, 2005, (03) : 507 - 510
  • [17] Weighted Transductive Support Vector Machines for text classification
    Liu, Shuang
    Jia, Chuanying
    Ma, Heng
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 445 - 449
  • [18] Probability-Enhanced Sufficient Dimension Reduction for Binary Classification
    Shin, Seung Jun
    Wu, Yichao
    Zhang, Hao Helen
    Liu, Yufeng
    BIOMETRICS, 2014, 70 (03) : 546 - 555
  • [19] A Bayesian approach to support vector machines for the binary classification
    Yu, Jiangsheng
    Cheng, Fei
    Xiong, Huilin
    Qu, Wanling
    Chen, Xue-Wen
    NEUROCOMPUTING, 2008, 72 (1-3) : 177 - 185
  • [20] On the parameter optimization of Support Vector Machines for binary classification
    Gaspar, Paulo
    Carbonell, Jaime
    Luis Oliveira, Jose
    JOURNAL OF INTEGRATIVE BIOINFORMATICS, 2012, 9 (03)