A new algorithm for support vector regression with automatic selection of hyperparameters

被引:27
|
作者
Wang, You-Gan
Wu, Jinran [2 ]
Hu, Zhi-Hua [3 ]
McLachlan, Geoffrey J. [1 ,4 ]
机构
[1] Australian Catholic Univ, Brisbane, Qld 4000, Australia
[2] Queensland Univ Technol, Brisbane, Qld 4001, Australia
[3] Shanghai Maritime Univ, Shanghai 201306, Peoples R China
[4] Univ Queensland, St Lucia, Qld 4072, Australia
基金
澳大利亚研究理事会;
关键词
Automatic selection; Loss functions; Noise models; Parameter estimation; Probability regularization; GAS SOLUBILITY OPTIMIZATION; PARAMETER SELECTION;
D O I
10.1016/j.patcog.2022.108989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The hyperparameters in support vector regression (SVR) determine the effectiveness of the support vectors with fitting and predictions. However, the choice of these hyperparameters has always been challenging in both theory and practice. The v-support vector regression eliminates the need to specify an is an element of value elegantly, but at the cost of specifying or postulating a v value. We propose an extended primal objective function arising from probability regularization leading to an automatic selection of is an element of, and we can express v as an explicit function of is an element of. The resultant hyperparameter values can be interpreted as 'working' values required only in training but not testing or prediction. This regularized algorithm, namely is an element of*-SVR, automatically provides a data-dependent is an element of and is found to have a close connection to the v-support vector regression in the sense that v as a fraction is a sensible function of is an element of. The is an element of*- SVR automatically selects both v and is an element of values. We illustrate these findings with some public benchmark datasets.(C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Model selection of support vector regression using particle swarm optimization algorithm
    Yang, HZ
    Shao, XG
    Chen, G
    Ding, F
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES A-MATHEMATICAL ANALYSIS, 2006, 13 : 1417 - 1425
  • [22] Support Vector Regression and Immune Clone Selection Algorithm for Predicting Financial Distress
    Tian, WenJie
    Wang, ManYi
    2009 INTERNATIONAL CONFERENCE ON BUSINESS INTELLIGENCE AND FINANCIAL ENGINEERING, PROCEEDINGS, 2009, : 130 - 133
  • [23] A stock selection algorithm hybridizing grey wolf optimizer and support vector regression
    Liu, Meng
    Luo, Kaiping
    Zhang, Junhuan
    Chen, Shengli
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 179
  • [24] System reliability prediction by support vector regression with analytic selection and genetic algorithm parameters selection
    Zhao, Wei
    Tao, Tao
    Zio, Enrico
    APPLIED SOFT COMPUTING, 2015, 30 : 792 - 802
  • [25] A new regularized least squares support vector regression for gene selection
    Chen, Pei-Chun
    Huang, Su-Yun
    Chen, Wei J.
    Hsiao, Chuhsing K.
    BMC BIOINFORMATICS, 2009, 10
  • [26] A new regularized least squares support vector regression for gene selection
    Pei-Chun Chen
    Su-Yun Huang
    Wei J Chen
    Chuhsing K Hsiao
    BMC Bioinformatics, 10
  • [27] Goodnews Bay Platinum Resource Estimation Using Least Squares Support Vector Regression with Selection of Input Space Dimension and Hyperparameters
    Chatterjee S.
    Bandopadhyay S.
    Natural Resources Research, 2011, 20 (2) : 117 - 129
  • [28] F-SVR:: A new learning algorithm for support vector regression
    Tohme, Mireille
    Lengelle, Regis
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 2005 - +
  • [29] On the optimization of the support vector machine regression hyperparameters setting for gas sensors array applications
    Laref, R.
    Losson, E.
    Sava, A.
    Siadat, M.
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2019, 184 : 22 - 27
  • [30] Training Subset Selection for Support Vector Regression
    Liu, Cenru
    Cen, Jiahao
    PROCEEDINGS OF THE 2019 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS), 2019, : 11 - 14