The soft-margin Support Vector Machine with ordered weighted average

被引:12
|
作者
Marin, Alfredo [1 ]
Martinez-Merino, Luisa I. [2 ,3 ,4 ]
Puerto, Justo [2 ]
Rodriguez-Chia, Antonio M. [3 ]
机构
[1] Univ Murcia, Fac Matemat, Dept Estadist & Invest Operat, Murcia, Spain
[2] Univ Sevilla IMUS, Inst Matemat, Seville, Spain
[3] Univ Cadiz, Fac Ciencias, Dept Estadist & Invest Operat, Puerto Real, Cadiz, Spain
[4] Univ Cadiz, Puerto Real, Cadiz, Spain
关键词
Data science; Classification; Support Vector Machine; OWA operators; Mixed integer quadratic programming; FEATURE-SELECTION; FORMULATIONS;
D O I
10.1016/j.knosys.2021.107705
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper deals with a cost sensitive extension of the standard Support Vector Machine (SVM) using an ordered weighted sum of the deviations of misclassified individuals with respect to their corresponding supporting hyperplanes. In contrast with previous heuristic approaches, an exact method that applies the ordered weighted average operator in the classical SVM model is proposed. Specifically, when weights are sorted in non-decreasing order, a quadratic continuous formulation is developed. For general weights, a mixed integer quadratic formulation is proposed. In addition, our results prove that nonlinear kernel functions can be also applied to these new models extending its applicability beyond the linear case. Extensive computational results reported in the paper show that the predictive performance provided by the proposed exact solution approaches are better than the ones provided by the classical models (linear and nonlinear kernel) and similar or better than the previous ones provided by the heuristic solution by Maldonado et al. (2018). (c) 2021 The Authors. Published by Elsevier B.V.This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by- nc- nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Weighted support vector machine for data classification
    Yang, XL
    Song, Q
    Cao, AZ
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 859 - 864
  • [42] Distance-weighted Support Vector Machine
    Qiao, Xingye
    Zhang, Lingsong
    STATISTICS AND ITS INTERFACE, 2015, 8 (03) : 331 - 345
  • [43] A weighted support vector machine for data classification
    Yang, Xulei
    Song, Qing
    Wang, Yue
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2007, 21 (05) : 961 - 976
  • [44] Feature and Sample Weighted Support Vector Machine
    Zhang, Qiongsheng
    Liu, Dong
    Fan, Zhidong
    Lee, Ying
    Li, Zhuojun
    KNOWLEDGE ENGINEERING AND MANAGEMENT, 2011, 123 : 365 - 371
  • [45] Weighted Least Square - Support Vector Machine
    Cuong Nguyen The
    Phung Huynh The
    2021 RIVF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION TECHNOLOGIES (RIVF 2021), 2021, : 168 - 173
  • [46] SMLBoost-adopting a soft-margin like strategy in boosting
    Chen, Zhi
    Duan, Jiang
    Yang, Cheng
    Kang, Li
    Qiu, Guoping
    KNOWLEDGE-BASED SYSTEMS, 2020, 195
  • [47] Optimizing Margin In Weighted Support Vector Machines For Flood Problem
    Salleh, Mohd Najib Mohd
    Talpur, Kashif Hussain
    Dzulkifli, Syahizul Amri
    6TH IEEE INTERNATIONAL CONFERENCE ON RECENT ADVANCES AND INNOVATIONS IN ENGINEERING (ICRAIE), 2021,
  • [48] A rough margin based fuzzy support vector machine
    Li, Kai
    Lu, Xiao-Xia
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2013, 41 (06): : 1183 - 1187
  • [49] A new multivariate extended homogeneously weighted moving average monitoring scheme incorporated with a support vector machine
    Pieters, Luke
    Malela-Majika, Jean-Claude
    Human, Schalk
    Castagliola, Philippe
    QUALITY AND RELIABILITY ENGINEERING INTERNATIONAL, 2023, 39 (06) : 2454 - 2475
  • [50] Dual margin approach on a Lagrangian support vector machine
    Hwang, Jae Pil
    Park, Seongkeun
    Kim, Euntai
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2011, 88 (04) : 695 - 708