The soft-margin Support Vector Machine with ordered weighted average

被引:12
|
作者
Marin, Alfredo [1 ]
Martinez-Merino, Luisa I. [2 ,3 ,4 ]
Puerto, Justo [2 ]
Rodriguez-Chia, Antonio M. [3 ]
机构
[1] Univ Murcia, Fac Matemat, Dept Estadist & Invest Operat, Murcia, Spain
[2] Univ Sevilla IMUS, Inst Matemat, Seville, Spain
[3] Univ Cadiz, Fac Ciencias, Dept Estadist & Invest Operat, Puerto Real, Cadiz, Spain
[4] Univ Cadiz, Puerto Real, Cadiz, Spain
关键词
Data science; Classification; Support Vector Machine; OWA operators; Mixed integer quadratic programming; FEATURE-SELECTION; FORMULATIONS;
D O I
10.1016/j.knosys.2021.107705
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper deals with a cost sensitive extension of the standard Support Vector Machine (SVM) using an ordered weighted sum of the deviations of misclassified individuals with respect to their corresponding supporting hyperplanes. In contrast with previous heuristic approaches, an exact method that applies the ordered weighted average operator in the classical SVM model is proposed. Specifically, when weights are sorted in non-decreasing order, a quadratic continuous formulation is developed. For general weights, a mixed integer quadratic formulation is proposed. In addition, our results prove that nonlinear kernel functions can be also applied to these new models extending its applicability beyond the linear case. Extensive computational results reported in the paper show that the predictive performance provided by the proposed exact solution approaches are better than the ones provided by the classical models (linear and nonlinear kernel) and similar or better than the previous ones provided by the heuristic solution by Maldonado et al. (2018). (c) 2021 The Authors. Published by Elsevier B.V.This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by- nc- nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Soft-margin Ellipsoid generative adversarial networks
    Jiang, Zheng
    Liu, Bin
    Huang, Weihua
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [32] Weighted support vector machine for classification
    Du, SX
    Chen, ST
    INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOL 1-4, PROCEEDINGS, 2005, : 3866 - 3871
  • [33] Feature weighted support vector machine
    Wang, Ting-Hua
    Tian, Sheng-Feng
    Huang, Hou-Kuan
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2009, 31 (03): : 514 - 518
  • [34] Improved Weighted Support Vector Machine
    Li Wanling
    Chen Peng
    Song Xiangjun
    PROCEEDINGS OF THE 2016 5TH INTERNATIONAL CONFERENCE ON ADVANCED MATERIALS AND COMPUTER SCIENCE, 2016, 80 : 14 - 17
  • [35] Soft-margin hyperdisk tensor machine and its application to the intelligent fault diagnosis of rotating machinery
    Liu, Hailong
    Yang, Yu
    Hu, Niaoqing
    Cheng, Zhe
    Cheng, Junsheng
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (12)
  • [36] A rough margin based support vector machine
    Zhang, Junhua
    Wang, Yuanyuan
    INFORMATION SCIENCES, 2008, 178 (09) : 2204 - 2214
  • [37] Ensemble Soft-Margin Softmax Loss for Image Classification
    Wang, Xiaobo
    Zhang, Shifeng
    Lei, Zhen
    Liu, Si
    Guo, Xiaojie
    Li, Stan Z.
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 992 - 998
  • [38] Small Target Detection in Sea Clutter by Weighted Biased Soft-Margin SVM Algorithm in Feature Spaces
    Shui, Peng-Lang
    Zhang, Lu-Xi
    Bai, Xiao-Hui
    IEEE SENSORS JOURNAL, 2024, 24 (07) : 10419 - 10433
  • [39] Additive weighted ordered weighted average
    Whalen, Thomas
    NAFIPS 2007 - 2007 ANNUAL MEETING OF THE NORTH AMERICAN FUZZY INFORMATION PROCESSING SOCIETY, 2007, : 393 - 398
  • [40] Impact of Setting Margin on Margin Setting Algorithm and Support Vector Machine
    Wang, Yi
    Fu, Jian
    Pan, W. David
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2018, 62 (03)