A new algorithm for support vector regression with automatic selection of hyperparameters

被引:27
|
作者
Wang, You-Gan
Wu, Jinran [2 ]
Hu, Zhi-Hua [3 ]
McLachlan, Geoffrey J. [1 ,4 ]
机构
[1] Australian Catholic Univ, Brisbane, Qld 4000, Australia
[2] Queensland Univ Technol, Brisbane, Qld 4001, Australia
[3] Shanghai Maritime Univ, Shanghai 201306, Peoples R China
[4] Univ Queensland, St Lucia, Qld 4072, Australia
基金
澳大利亚研究理事会;
关键词
Automatic selection; Loss functions; Noise models; Parameter estimation; Probability regularization; GAS SOLUBILITY OPTIMIZATION; PARAMETER SELECTION;
D O I
10.1016/j.patcog.2022.108989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The hyperparameters in support vector regression (SVR) determine the effectiveness of the support vectors with fitting and predictions. However, the choice of these hyperparameters has always been challenging in both theory and practice. The v-support vector regression eliminates the need to specify an is an element of value elegantly, but at the cost of specifying or postulating a v value. We propose an extended primal objective function arising from probability regularization leading to an automatic selection of is an element of, and we can express v as an explicit function of is an element of. The resultant hyperparameter values can be interpreted as 'working' values required only in training but not testing or prediction. This regularized algorithm, namely is an element of*-SVR, automatically provides a data-dependent is an element of and is found to have a close connection to the v-support vector regression in the sense that v as a fraction is a sensible function of is an element of. The is an element of*- SVR automatically selects both v and is an element of values. We illustrate these findings with some public benchmark datasets.(C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Segmental online support vector regression algorithm
    Liu, Datong
    Peng, Yu
    Peng, Xiyuan
    Yu, Jiang
    Chen, Qiang
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2010, 31 (08): : 1732 - 1737
  • [42] Research on an algorithm of support vector stepwise regression
    Zeng, Shaohua
    Wei, Yan
    Duan, Tingcai
    Cao, Changxiu
    ICICIC 2006: FIRST INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING, INFORMATION AND CONTROL, VOL 3, PROCEEDINGS, 2006, : 452 - +
  • [43] Pairing support vector algorithm for data regression
    Hao, Pei-Yi
    NEUROCOMPUTING, 2017, 225 : 174 - 187
  • [44] A New Pairing Support Vector Regression
    Hao, Pei-Yi
    Intelligent Information and Database Systems, Pt I, 2015, 9011 : 327 - 336
  • [45] Shrinking the tube: A new Support Vector Regression algorithm with parametric insensitive model
    Hao, Pei-Yi
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 1871 - 1874
  • [46] Efficient computation and model selection for the support vector regression
    Gunter, Lacey
    Zhu, Ji
    NEURAL COMPUTATION, 2007, 19 (06) : 1633 - 1655
  • [47] Parameters selection of support vector regression by genetic algorithms
    Xi'an Univ. of Science and Technology, Xi'an 710054, China
    Xi Tong Cheng Yu Dian Zi Ji Shu/Syst Eng Electron, 2006, 9 (1430-1433):
  • [48] Gloss patch selection based on support vector regression
    Kuo, CH
    Ng, Y
    Wang, CJ
    PICS 2002: IMAGE PROCESSING, IMAGE QUALITY, IMAGE CAPTURE, SYSTEMS CONFERENCE, PROCEEDINGS, 2002, : 121 - 125
  • [49] Nonlinear feature selection for support vector quantile regression
    Ye, Ya-Fen
    Wang, Jie
    Chen, Wei-Jie
    NEURAL NETWORKS, 2025, 185
  • [50] Feature Selection Based on Twin Support Vector Regression
    Wu, Qing
    Zhang, Haoyi
    Jing, Rongrong
    Li, Yiran
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2903 - 2907