l1/2-based penalized clustering with half thresholding algorithm

被引:3
|
作者
Wang, Xingwei [1 ]
Zhang, Hongjuan [1 ]
机构
[1] Shanghai Univ, Dept Math, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Half thresholding algorithm; l(1/2) regularization; Penalized clustering; L-1/2; REGULARIZATION; CONVERGENCE;
D O I
10.1016/j.neucom.2020.01.058
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Clustering is a widely applied method in data analysis. As a novel framework of clustering analysis, penalized clustering bases itself on the sparsity of solution, which contributes to its ability of determining the best number of clusters automatically rather than specified in advance. Moreover, l(1/2) regularization has been recognized extensively in recent studies. Compared with other l(p) (0 < p < 1) regularization, it can always obtain sparser solution. Motivated by these two points, we propose a l(1/2)-basedpenalized clustering model, and further transform it into a more general form by introducing the vector comprising pairwise differences between centroids and an auxiliary transfer matrix composed of identity matrixes and null matrixes. Finally, the transformed model is solved by the efficient half thresholding algorithm, which can not only obtain an exact analytic expression of l(1/2) solutions, but also provide an effective parameter selection strategy. We also prove the convergence of the proposed half thresholding algorithm solving l(1/2)-based penalized clustering model. Lastly but not least importantly, benchmark experiments on both synthesis and real data sets from UCI have been conducted to prove the superiority of the proposed method. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:253 / 263
页数:11
相关论文
共 50 条
  • [1] L1/2 Regularization: Convergence of Iterative Half Thresholding Algorithm
    Zeng, Jinshan
    Lin, Shaobo
    Wang, Yao
    Xu, Zongben
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (09) : 2317 - 2329
  • [2] Analysis L1/2 Regularization: Iterative Half Thresholding Algorithm for CS-MRI
    Yuan, Lianjun
    Li, Yunyi
    Dai, Fei
    Long, Yan
    Cheng, Xiefeng
    Gui, Guan
    IEEE ACCESS, 2019, 7 : 79366 - 79373
  • [3] Adaptive L1/2 Sparsity-Constrained NMF With Half-Thresholding Algorithm for Hyperspectral Unmixing
    Wang, Wenhong
    Qian, Yuntao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2015, 8 (06) : 2618 - 2631
  • [4] Tangent vector-based gradient method with l1/2-regularization: Iterative half thresholding algorithm for CS-MRI
    Qureshi, M.
    Inam, O.
    Qazi, S. A.
    Aslam, I.
    Omer, H.
    JOURNAL OF MAGNETIC RESONANCE, 2021, 333
  • [5] A coordinate majorization descent algorithm for l1 penalized learning
    Yang, Yi
    Zou, Hui
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2014, 84 (01) : 84 - 95
  • [6] On convergence of Weak Thresholding Greedy Algorithm in L1 (0,1)
    Gogyan, Smbat
    JOURNAL OF APPROXIMATION THEORY, 2009, 161 (01) : 49 - 64
  • [7] Track clustering and vertexing algorithm for L1 trigger
    Cancelo, Gustavo I.
    2005 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2005, : 264 - 268
  • [8] A novel iterative soft thresholding algorithm for L1 regularization based SAR image enhancement
    Hui Bi
    Guoan Bi
    Science China Information Sciences, 2019, 62
  • [9] A novel iterative soft thresholding algorithm for L1 regularization based SAR image enhancement
    Hui BI
    Guoan BI
    Science China(Information Sciences), 2019, 62 (04) : 212 - 214
  • [10] A novel iterative soft thresholding algorithm for L1 regularization based SAR image enhancement
    Bi, Hui
    Bi, Guoan
    SCIENCE CHINA-INFORMATION SCIENCES, 2019, 62 (04)