Global and local structure preserving sparse subspace learning: An iterative approach to unsupervised feature selection

被引:73
|
作者
Zhou, Nan [1 ,2 ]
Xu, Yangyang [3 ]
Cheng, Hong [1 ]
Fang, Jun [1 ]
Pedrycz, Witold [2 ,4 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Robot, Sch Automat Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[3] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
[4] King Abdulaziz Univ, Fac Engn, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
基金
加拿大自然科学与工程研究理事会;
关键词
Machine learning; Feature selection; Subspace learning; Unsupervised learning; DIMENSIONALITY REDUCTION; DISCRIMINANT; RECOVERY;
D O I
10.1016/j.patcog.2015.12.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global and local structures as the both of them contain important information. In this paper, we propose a global and local structure preserving sparse subspace learning (GLOSS) model for unsupervised feature selection. The model can simultaneously realize feature selection and subspace learning. In addition, we develop a greedy algorithm to establish a generic combinatorial model, and an iterative strategy based on an accelerated block coordinate descent is used to solve the GLoSS problem. We also provide whole iterate sequence convergence analysis of the proposed iterative algorithm. Extensive experiments are conducted on real-world datasets to show the superiority of the proposed approach over several state-of-the-art unsupervised feature selection approaches. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 101
页数:15
相关论文
共 50 条
  • [21] Subspace learning for unsupervised feature selection via adaptive structure learning and rank approximation
    Shang, Ronghua
    Xu, Kaiming
    Jiao, Licheng
    NEUROCOMPUTING, 2020, 413 (413) : 72 - 84
  • [22] Joint subspace learning and subspace clustering based unsupervised feature selection
    Xiao, Zijian
    Chen, Hongmei
    Mi, Yong
    Luo, Chuan
    Horng, Shi-Jinn
    Li, Tianrui
    NEUROCOMPUTING, 2025, 635
  • [23] Unsupervised feature selection via joint local learning and group sparse regression
    Yue Wu
    Can Wang
    Yue-qing Zhang
    Jia-jun Bu
    Frontiers of Information Technology & Electronic Engineering, 2019, 20 : 538 - 553
  • [24] Unsupervised feature selection via joint local learning and group sparse regression
    Wu, Yue
    Wang, Can
    Zhang, Yue-qing
    Bu, Jia-jun
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2019, 20 (04) : 538 - 553
  • [25] Unsupervised feature selection via joint local learning and group sparse regression
    Yue WU
    Can WANG
    Yue-qing ZHANG
    Jia-jun BU
    Frontiers of Information Technology & Electronic Engineering, 2019, 20 (04) : 538 - 553
  • [26] Unsupervised feature selection based on self-representation sparse regression and local similarity preserving
    Shang, Ronghua
    Chang, Jiangwei
    Jiao, Licheng
    Xue, Yu
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (04) : 757 - 770
  • [27] Unsupervised Feature Selection Via Orthogonal Basis Clustering and Local Structure Preserving
    Lin, Xiaochang
    Guan, Jiewen
    Chen, Bilian
    Zeng, Yifeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6881 - 6892
  • [28] Unsupervised feature selection based on self-representation sparse regression and local similarity preserving
    Ronghua Shang
    Jiangwei Chang
    Licheng Jiao
    Yu Xue
    International Journal of Machine Learning and Cybernetics, 2019, 10 : 757 - 770
  • [29] Soft Label Guided Unsupervised Discriminative Sparse Subspace Feature Selection
    Keding Chen
    Yong Peng
    Feiping Nie
    Wanzeng Kong
    Journal of Classification, 2024, 41 : 129 - 157
  • [30] Soft Label Guided Unsupervised Discriminative Sparse Subspace Feature Selection
    Chen, Keding
    Peng, Yong
    Nie, Feiping
    Kong, Wanzeng
    JOURNAL OF CLASSIFICATION, 2024, 41 (01) : 129 - 157