Principal weighted support vector machines for sufficient dimension reduction in binary classification

被引:31
|
作者
Shin, Seung Jun [1 ]
Wu, Yichao [2 ]
Zhang, Hao Helen [3 ]
Liu, Yufeng [4 ]
机构
[1] Korea Univ, Dept Stat, Seoul 02841, South Korea
[2] North Carolina State Univ, Dept Stat, 2311 Stinson Dr,Campus Box 8203, Raleigh, NC 27695 USA
[3] Univ Arizona, Dept Math, 617 North Santa Rita Ave,POB 210089, Tucson, AZ 85721 USA
[4] Univ North Carolina Chapel Hill, Dept Stat & Operat Res, 354 Hanes Hall, Chapel Hill, NC 27599 USA
基金
新加坡国家研究基金会; 美国国家卫生研究院; 美国国家科学基金会;
关键词
Fisher consistency; Hyperplane alignment; Reproducing kernel Hilbert space; Weighted support vector machine; SLICED INVERSE REGRESSION; CENTRAL SUBSPACE; HESSIAN DIRECTIONS;
D O I
10.1093/biomet/asw057
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sufficient dimension reduction is popular for reducing data dimensionality without stringent model assumptions. However, most existing methods may work poorly for binary classification. For example, sliced inverse regression (Li, 1991) can estimate at most one direction if the response is binary. In this paper we propose principal weighted support vector machines, a unified framework for linear and nonlinear sufficient dimension reduction in binary classification. Its asymptotic properties are studied, and an efficient computing algorithm is proposed. Numerical examples demonstrate its performance in binary classification.
引用
收藏
页码:67 / 81
页数:15
相关论文
共 50 条
  • [21] SUPPORT VECTOR MACHINES APPLIED TO BINARY CLASSIFICATION PROBLEMS
    Hoyo, Alexander
    CISCI 2007: 6TA CONFERENCIA IBEROAMERICANA EN SISTEMAS, CIBERNETICA E INFORMATICA, MEMORIAS, VOL I, 2007, : 49 - 54
  • [22] Sufficient dimension reduction for classification using principal optimal transport direction
    Meng, Cheng
    Yu, Jun
    Zhang, Jingyi
    Ma, Ping
    Zhong, Wenxuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [23] Support Vector Machines with Weighted Powered Kernels for Data Classification
    Afif, Mohammed H.
    Hedar, Abdel-Rahman
    Hamid, Taysir H. Abdel
    Mahdy, Yousef B.
    ADVANCED MACHINE LEARNING TECHNOLOGIES AND APPLICATIONS, 2012, 322 : 369 - 378
  • [24] Hypertext classification using weighted transductive support vector machines
    Liu, Shuang
    Jia, Chuan-Ying
    Chen, Peng
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 3535 - +
  • [25] Binary Classification of Aqueous Solubility Using Support Vector Machines with Reduction and Recombination Feature Selection
    Cheng, Tiejun
    Li, Qingliang
    Wang, Yanli
    Bryant, Stephen H.
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2011, 51 (02) : 229 - 236
  • [26] A study on imbalance support vector machine algorithms for sufficient dimension reduction
    Smallman, Luke
    Artemiou, Andreas
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (06) : 2751 - 2763
  • [27] Granular support vector machines for medical binary classification problems
    Tang, YC
    Jin, B
    Sun, Y
    Zhang, YQ
    PROCEEDINGS OF THE 2004 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, 2004, : 73 - 78
  • [28] Principal Components, Sufficient Dimension Reduction, and Envelopes
    Cook, R. Dennis
    ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, VOL 5, 2018, 5 : 533 - 559
  • [29] Breast Cancer Classification by Using Support Vector Machines with Reduced Dimension
    Mert, Ahmet
    Kilic, Niyazi
    Akan, Aydin
    53RD INTERNATIONAL SYMPOSIUM ELMAR-2011, 2011, : 37 - 40
  • [30] Input dimension reduction for load forecasting based on support vector machines
    Xu, T
    He, RM
    Wang, P
    Xu, DJ
    PROCEEDINGS OF THE 2004 IEEE INTERNATIONAL CONFERENCE ON ELECTRIC UTILITY DEREGULATION, RESTRUCTURING AND POWER TECHNOLOGIES, VOLS 1 AND 2, 2004, : 510 - 514