The soft-margin Support Vector Machine with ordered weighted average

被引:12
|
作者
Marin, Alfredo [1 ]
Martinez-Merino, Luisa I. [2 ,3 ,4 ]
Puerto, Justo [2 ]
Rodriguez-Chia, Antonio M. [3 ]
机构
[1] Univ Murcia, Fac Matemat, Dept Estadist & Invest Operat, Murcia, Spain
[2] Univ Sevilla IMUS, Inst Matemat, Seville, Spain
[3] Univ Cadiz, Fac Ciencias, Dept Estadist & Invest Operat, Puerto Real, Cadiz, Spain
[4] Univ Cadiz, Puerto Real, Cadiz, Spain
关键词
Data science; Classification; Support Vector Machine; OWA operators; Mixed integer quadratic programming; FEATURE-SELECTION; FORMULATIONS;
D O I
10.1016/j.knosys.2021.107705
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper deals with a cost sensitive extension of the standard Support Vector Machine (SVM) using an ordered weighted sum of the deviations of misclassified individuals with respect to their corresponding supporting hyperplanes. In contrast with previous heuristic approaches, an exact method that applies the ordered weighted average operator in the classical SVM model is proposed. Specifically, when weights are sorted in non-decreasing order, a quadratic continuous formulation is developed. For general weights, a mixed integer quadratic formulation is proposed. In addition, our results prove that nonlinear kernel functions can be also applied to these new models extending its applicability beyond the linear case. Extensive computational results reported in the paper show that the predictive performance provided by the proposed exact solution approaches are better than the ones provided by the classical models (linear and nonlinear kernel) and similar or better than the previous ones provided by the heuristic solution by Maldonado et al. (2018). (c) 2021 The Authors. Published by Elsevier B.V.This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by- nc- nd/4.0/).
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Dimensionality Reduction by Soft-Margin Support Vector Machine
    Dong, Ruipeng
    Meng, Hua
    Long, Zhiguo
    Zhao, Hailiang
    2017 IEEE INTERNATIONAL CONFERENCE ON AGENTS (ICA), 2017, : 154 - 156
  • [2] Support Vector Machine for Data with Tolerance based on Hard-Margin and Soft-Margin
    Yukihiro, Hamasuna
    Yasunori, Endo
    Sadaaki, Miyamoto
    2008 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-5, 2008, : 750 - +
  • [3] Interval Regression Analysis with Soft-Margin Reduced Support Vector Machine
    Huang, Chia-Hui
    Kao, Han-Ying
    NEXT-GENERATION APPLIED INTELLIGENCE, PROCEEDINGS, 2009, 5579 : 826 - +
  • [4] Detection of crack eggs by image processing and soft-margin support vector machine
    Wu, Lanlan
    Wang, Qiaohua
    Jie, Dengfei
    Wang, Shucai
    Zhu, Zhihui
    Xiong, Lirong
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2018, 18 (01) : 21 - 31
  • [5] Stream-suitable optimization algorithms for some soft-margin support vector machine variants
    Nguyen, Hien D.
    Jones, Andrew T.
    McLachlan, Geoffrey J.
    JAPANESE JOURNAL OF STATISTICS AND DATA SCIENCE, 2018, 1 (01) : 81 - 108
  • [6] Support Vector Machine Classifier via L0/1 Soft-Margin Loss
    Wang, Huajun
    Shao, Yuanhai
    Zhou, Shenglong
    Zhang, Ce
    Xiu, Naihua
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7253 - 7265
  • [7] Stream-suitable optimization algorithms for some soft-margin support vector machine variants
    Hien D. Nguyen
    Andrew T. Jones
    Geoffrey J. McLachlan
    Japanese Journal of Statistics and Data Science, 2018, 1 (1) : 81 - 108
  • [8] Polarized skylight compass based on a soft-margin support vector machine working in cloudy conditions
    Liang, Huaju
    Bai, Hongyang
    Liu, Ning
    Sui, Xiubao
    APPLIED OPTICS, 2020, 59 (05) : 1271 - 1279
  • [9] Ordered Weighted Average Support Vector Regression
    Martinez-Merino, Luisa I.
    Puerto, Justo
    Rodriguez-Chia, Antonio M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 274
  • [10] Multiobjective Multiclass Soft-Margin Support Vector Machine Maximizing Pair-Wise Interclass Margins
    Tatsumi, Keiji
    Kawachi, Ryo
    Hayashida, Kenji
    Tanino, Tetsuzo
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 970 - 977