Robust and stochastic sparse subspace clustering

被引:0
|
作者
Zhu, Yanjiao [1 ]
Li, Xinrong [2 ]
Xiu, Xianchao [3 ]
Liu, Wanquan [4 ]
Yin, Chuancun [1 ]
机构
[1] Qufu Normal Univ, Sch Stat & Data Sci, Qufu, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang, Peoples R China
[3] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai, Peoples R China
[4] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse subspace clustering; Stochastic; Huber function; Proximal alternating minimization; MINIMIZATION; CONVERGENCE; ALGORITHMS; NONCONVEX;
D O I
10.1016/j.neucom.2024.128703
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sparse subspace clustering (SSC) has been widely employed in machine learning and pattern recognition, but it still faces scalability challenges when dealing with large-scale datasets. Recently, stochastic SSC (SSSC) has emerged as an effective solution by leveraging the dropout technique. However, SSSC cannot robustly handle noise, especially non-Gaussian noise, leading to unsatisfactory clustering performance. To address the above issues, we propose a novel robust and stochastic method called stochastic sparse subspace clustering with the Huber function (S3CH). The key idea is to introduce the Huber surrogate to measure the loss of the stochastic self-expression framework, thus S3CH inherits the advantage of the stochastic framework for large-scale problems while mitigating sensitivity to non-Gaussian noise. In algorithms, an efficient proximal alternating minimization (PAM)-based optimization scheme is developed. In theory, the convergence of the generated sequence is rigorously proved. Extensive numerical experiments on synthetic and six real datasets validate the advantages of the proposed method in clustering accuracy, noise robustness, parameter sensitivity, post-hoc analysis, and model stability.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Graph Connectivity In Sparse Subspace Clustering
    Nasihatkon, Behrooz
    Hartley, Richard
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011,
  • [32] Sparse Subspace Clustering for Incomplete Images
    Wen, Xiao
    Qiao, Linbo
    Ma, Shiqian
    Liu, Wei
    Cheng, Hong
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW), 2015, : 859 - 867
  • [33] Efficient Solvers for Sparse Subspace Clustering
    Pourkamali-Anaraki, Farhad
    Folberth, James
    Becker, Stephen
    SIGNAL PROCESSING, 2020, 172
  • [34] Sparse Subspace Clustering for Stream Data
    Chen, Ken
    Tang, Yong
    Wei, Long
    Wang, Pengfei
    Liu, Yong
    Jin, Zhongming
    IEEE ACCESS, 2021, 9 : 57271 - 57279
  • [35] Sparse-Dense Subspace Clustering
    Yang, Shuai
    Zhu, Wenqi
    Zhu, Yuesheng
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 247 - 254
  • [36] Decentralized Robust Subspace Clustering
    Liu, Bo
    Yuan, Xiao-Tong
    Yu, Yang
    Liu, Qingshan
    Metaxas, Dimitris N.
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 3539 - 3545
  • [37] Deep Bayesian Sparse Subspace Clustering
    Ye, Xulun
    Luo, Shuhui
    Chao, Jieyu
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1888 - 1892
  • [38] Sparse Subspace Clustering with Missing Entries
    Yang, Congyuan
    Robinson, Daniel
    Vidal, Rene
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 2463 - 2472
  • [39] Subspace Structure-aware Spectral Clustering for Robust Subspace Clustering
    Yamaguchi, Masataka
    Irie, Go
    Kawanishi, Takahito
    Kashino, Kunio
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9874 - 9883
  • [40] Robust sparse coding for subspace learning
    Dai, Xiangguang
    Tao, Yingyin
    Xiong, Jiang
    Feng, Yuming
    ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2020, (44): : 986 - 994