The new interpretation of support vector machines on statistical learning theory

被引：32

作者：

Zhang ChunHua ^{[2
]}

Tian YingJie ^{[3
]}

Deng NaiYang ^{[1
]}

机构：

[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China

[2] Renmin Univ China, Sch Informat, Beijing 100872, Peoples R China

[3] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100080, Peoples R China

来源：

SCIENCE CHINA-MATHEMATICS | 2010年 / 53卷 / 01期

基金：

中国国家自然科学基金;

关键词：

C-support vector classification; the minimization principle of the structural risk; KKT conditions; CLASSIFICATION; CONSISTENCY;

D O I：

10.1007/s11425-010-0018-6

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

This paper is concerned with the theoretical foundation of support vector machines (SVMs). The purpose is to develop further an exact relationship between SVMs and the statistical learning theory (SLT). As a representative, the standard C-support vector classification (C-SVC) is considered here. More precisely, we show that the decision function obtained by C-SVC is just one of the decision functions obtained by solving the optimization problem derived directly from the structural risk minimization principle. In addition, an interesting meaning of the parameter C in C-SVC is given by showing that C corresponds to the size of the decision function candidate set in the structural risk minimization principle.

引用

页码：151 / 164

页数：14

共 50 条

[11] Algorithm of Support Vector Machines Based on Statistics Learning Theory
Hao, Zhongxiao
Qu, Xilong
Liu, Yingchun
PROCEEDINGS OF THE 14TH YOUTH CONFERENCE ON COMMUNICATION, 2009, : 303 - +
[12] New kind of machine learning algorithm: support vector machines
2000, J Pattern Recognit Artif Intell, China (13):
[13] Learning curves of support vector machines
Ikeda, K
PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 1708 - 1713
[14] Active learning with support vector machines
Kremer, Jan
Pedersen, Kim Steenstrup
Igel, Christian
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 4 (04) : 313 - 326
[15] Incremental learning with Support Vector Machines
Rüping, S
2001 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2001, : 641 - 642
[16] Learning with rigorous support vector machines
Bi, J
Vapnik, VN
LEARNING THEORY AND KERNEL MACHINES, 2003, 2777 : 243 - 257
[17] Application of support vector machines to an image interpretation problem
Crisp, David J.
Bogner, Robert E.
International Conference on Knowledge-Based Intelligent Electronic Systems, Proceedings, KES, 1999, : 381 - 384
[18] Learning to classify text using support vector machines: Methods, theory, and algorithms
Basili, R
COMPUTATIONAL LINGUISTICS, 2003, 29 (04) : 655 - 661
[19] Model Selection for Support Vector Machines: Advantages and Disadvantages of the Machine Learning Theory
Anguita, Davide
Ghio, Alessandro
Greco, Noemi
Oneto, Luca
Ridella, Sandro
2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,
[20] Statistical Properties and Adaptive Tuning of Support Vector Machines
Yi Lin
Grace Wahba
Hao Zhang
Yoonkyung Lee
Machine Learning, 2002, 48 : 115 - 136

← 1 2 3 4 5 →