A new algorithm for support vector regression with automatic selection of hyperparameters

被引:27
|
作者
Wang, You-Gan
Wu, Jinran [2 ]
Hu, Zhi-Hua [3 ]
McLachlan, Geoffrey J. [1 ,4 ]
机构
[1] Australian Catholic Univ, Brisbane, Qld 4000, Australia
[2] Queensland Univ Technol, Brisbane, Qld 4001, Australia
[3] Shanghai Maritime Univ, Shanghai 201306, Peoples R China
[4] Univ Queensland, St Lucia, Qld 4072, Australia
基金
澳大利亚研究理事会;
关键词
Automatic selection; Loss functions; Noise models; Parameter estimation; Probability regularization; GAS SOLUBILITY OPTIMIZATION; PARAMETER SELECTION;
D O I
10.1016/j.patcog.2022.108989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The hyperparameters in support vector regression (SVR) determine the effectiveness of the support vectors with fitting and predictions. However, the choice of these hyperparameters has always been challenging in both theory and practice. The v-support vector regression eliminates the need to specify an is an element of value elegantly, but at the cost of specifying or postulating a v value. We propose an extended primal objective function arising from probability regularization leading to an automatic selection of is an element of, and we can express v as an explicit function of is an element of. The resultant hyperparameter values can be interpreted as 'working' values required only in training but not testing or prediction. This regularized algorithm, namely is an element of*-SVR, automatically provides a data-dependent is an element of and is found to have a close connection to the v-support vector regression in the sense that v as a fraction is a sensible function of is an element of. The is an element of*- SVR automatically selects both v and is an element of values. We illustrate these findings with some public benchmark datasets.(C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Data selection using support vector regression
    Richman, Michael B.
    Leslie, Lance M.
    Trafalis, Theodore B.
    Mansouri, Hicham
    ADVANCES IN ATMOSPHERIC SCIENCES, 2015, 32 (03) : 277 - 286
  • [32] Data Selection Using Support Vector Regression
    Michael B.RICHMAN
    Lance M.LESLIE
    Theodore B.TRAFALIS
    Hicham MANSOURI
    AdvancesinAtmosphericSciences, 2015, 32 (03) : 277 - 286
  • [33] Data selection using support vector regression
    Michael B. Richman
    Lance M. Leslie
    Theodore B. Trafalis
    Hicham Mansouri
    Advances in Atmospheric Sciences, 2015, 32 : 277 - 286
  • [34] Parameter Selection for Linear Support Vector Regression
    Hsia, Jui-Yang
    Lin, Chih-Jen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (12) : 5639 - 5644
  • [35] Selection method for hyper-parameters of support vector regression by chaotic cultural algorithm
    Guo, Yi-Nan
    Cheng, Jian
    Yang, Mei
    Kongzhi yu Juece/Control and Decision, 2010, 25 (04): : 525 - 530
  • [36] Nonlinear Support Vector Regression Model Selection Using Particle Swarm Optimization Algorithm
    T. L. Mohan Kumar
    National Academy Science Letters, 2017, 40 : 79 - 85
  • [37] Parameter selection of support vector regression based on hybrid optimization algorithm and its application
    Xin WANG 1
    2.Department of Electric Engineering
    Journal of Control Theory and Applications, 2005, (04) : 371 - 376
  • [38] Parameter selection of support vector regression based on hybrid optimization algorithm and its application
    Xin Wang
    Chunhua Yang
    Bin Qin
    Weihua Gui
    Journal of Control Theory and Applications, 2005, 3 (4): : 371 - 376
  • [39] Nonlinear Support Vector Regression Model Selection Using Particle Swarm Optimization Algorithm
    Kumar, T. L. Mohan
    Prajneshu
    NATIONAL ACADEMY SCIENCE LETTERS-INDIA, 2017, 40 (02): : 79 - 85
  • [40] Improved heuristic algorithm for support vector regression
    Yang Hui-zhong
    Shao Xin-guang
    Shi Chen-xi
    Proceedings of 2005 Chinese Control and Decision Conference, Vols 1 and 2, 2005, : 860 - 862