Stochastic Gradient Descent Support Vector Clustering

被引:0
|
作者
Tung Pham [1 ]
Hang Dang [1 ]
Trung Le [2 ]
Hoang-Thai Le [1 ]
机构
[1] HCMc Univ Sci, Fac Informat Technol, Ho Chi Minh City, Vietnam
[2] HCMc Univ Pedag, Fac Informat Technol, Ho Chi Minh City, Vietnam
关键词
Support Vector Clustering; Stochastic Gradient Descent; Domain of Novelty; Clustering Analysis;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Support-based clustering method has recently drawn plenty of attention because of its applications in solving the difficult and diverse clustering or outlier detection problem. Support-based clustering method undergoes two phases: finding the domain of novelty and doing cluster assignment. To find the domain of novelty, the training time given by the current solvers is typically quadratic in the size of the training dataset. It impedes the use of support-based clustering method for the large-scale datasets. In this paper, we propose applying Stochastic Gradient Descent framework to the first phase of support-based clustering for finding the domain of novelty in form of a half-space. The experiment established of the large-scale datasets shows that the proposed method offers comparable cluster solution quality to the baseline while being able to run 200 times faster.
引用
收藏
页码:88 / 93
页数:6
相关论文
共 50 条
  • [1] Large-scale support vector regression with budgeted stochastic gradient descent
    Zongxia Xie
    Yingda Li
    International Journal of Machine Learning and Cybernetics, 2019, 10 : 1529 - 1541
  • [2] Large-scale support vector regression with budgeted stochastic gradient descent
    Xie, Zongxia
    Li, Yingda
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (06) : 1529 - 1541
  • [3] Parallel Implementation on FPGA of Support Vector Machines Using Stochastic Gradient Descent
    Lopes, Felipe E.
    Ferreira, Joao Canas
    Fernandes, Marcelo A. C.
    ELECTRONICS, 2019, 8 (06)
  • [4] vqSGD: Vector Quantized Stochastic Gradient Descent
    Gandikota, Venkata
    Kane, Daniel
    Maity, Raj Kumar
    Mazumdar, Arya
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (07) : 4573 - 4587
  • [5] vqSGD: Vector Quantized Stochastic Gradient Descent
    Gandikota, Venkata
    Kane, Daniel
    Maity, Raj Kumar
    Mazumdar, Arya
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [6] Hyperspectral Image Classification Using Stochastic Gradient Descent Based Support Vector Machine
    Sampurnima, Pattem
    Satapathy, Sandeep Kumar
    Mishra, Shruti
    Mallick, Pradeep Kumar
    BIOLOGICALLY INSPIRED TECHNIQUES IN MANY-CRITERIA DECISION MAKING, 2020, 10 : 78 - 84
  • [7] Hyper-parameter optimization for support vector machines using stochastic gradient descent and dual coordinate descent
    Jiang, Wei
    Siddiqui, Sauleh
    EURO JOURNAL ON COMPUTATIONAL OPTIMIZATION, 2020, 8 (01) : 85 - 101
  • [8] A new stochastic gradient descent possibilistic clustering algorithm
    Koutsimpela, Angeliki
    Koutroumbas, Konstantinos D.
    AI COMMUNICATIONS, 2022, 35 (02) : 47 - 64
  • [9] A modeling method for aero-engine by combining stochastic gradient descent with support vector regression
    Ren, Li-Hua
    Ye, Zhi-Feng
    Zhao, Yong-Ping
    AEROSPACE SCIENCE AND TECHNOLOGY, 2020, 99
  • [10] Stochastic Conjugate Gradient Descent Twin Support Vector Machine for Large Scale Pattern Classification
    Sharma, Sweta
    Rastogi, Reshma
    AI 2018: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, 11320 : 590 - 602