The generalization error of the symmetric and scaled support vector machines

被引:12
|
作者
Feng, JF [1 ]
Williams, P [1 ]
机构
[1] Univ Sussex, Sch Cognit & Comp Sci, Brighton BN1 9QH, E Sussex, England
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2001年 / 12卷 / 05期
关键词
generalization error; scaled SVM; SVM (SVM);
D O I
10.1109/72.950155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It is generally believed that the support vector machine (SVM) optimizes the generalization error and outperforms other learning machines. We show analytically, by concrete examples in the one dimensional case, that the SVM does improve the mean and standard deviation of the generalization error by a constant factor, compared to the worst learning machine. Our approach is in terms of extreme value theory and both the mean and variance of the generalization error are calculated exactly for all cases considered. We propose a new version of the SVM (scaled SVM) which can further reduce the mean of the generalization error of the SVM.
引用
收藏
页码:1255 / 1260
页数:6
相关论文
共 50 条
  • [11] Multi-scaled Forecasting Model Based on Support Vector Machines
    Qu, Wenlong
    Li, Ning
    He, Yichao
    Qu, Wenjing
    2010 2ND INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS PROCEEDINGS (DBTA), 2010,
  • [12] Training support vector machines based on stacked generalization for image classification
    Tsai, CF
    NEUROCOMPUTING, 2005, 64 : 497 - 503
  • [13] Selecting the Hypothesis Space for Improving the Generalization Ability of Support Vector Machines
    Anguita, Davide
    Ghio, Alessandro
    Oneto, Luca
    Ridella, Sandro
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 1169 - 1176
  • [14] Generalization properties of finite-size polynomial support vector machines
    Risau-Gusman, S
    Gordon, MB
    PHYSICAL REVIEW E, 2000, 62 (05) : 7092 - 7099
  • [15] Generalization performance of support vector machines and neural networks in runoff modeling
    Behzad, Mohsen
    Asghari, Keyvan
    Eazi, Morten
    Palhang, Maziar
    EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (04) : 7624 - 7629
  • [16] Estimation of the wind turbine yaw error by support vector machines
    Sheibat-Othman, Nida
    Othman, Sami
    Tayari, Raoaa
    Sakly, Anis
    Odgaard, Peter F.
    Larsen, Lars F. S.
    IFAC PAPERSONLINE, 2015, 48 (30): : 339 - 344
  • [17] Pruning error minimization in least squares support vector machines
    de Kruif, BJ
    de Vries, TJA
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (03): : 696 - 702
  • [18] IMPROVEMENTS OF THE RECOGNITION AND GENERALIZATION CAPACITIES OF THE NONLINEAR SOFT MARGIN SUPPORT VECTOR MACHINES
    State, Luminita
    Cocianu, Catalina
    Mircea, Marinela
    ECONOMIC COMPUTATION AND ECONOMIC CYBERNETICS STUDIES AND RESEARCH, 2014, 48 (04): : 17 - 38
  • [19] The MEMS IMU Error Modeling Analysis Using Support Vector Machines
    Xu, Guoqiang
    Meng, Xiuyun
    2009 SECOND INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING: KAM 2009, VOL 1, 2009, : 335 - 337
  • [20] Support Vector Machines Model for Classification of Thermal Error in Machine Tools
    R. Ramesh
    M.A. Mannan
    A.N. Poo
    The International Journal of Advanced Manufacturing Technology, 2002, 20 : 114 - 120