Global and local structure preserving sparse subspace learning: An iterative approach to unsupervised feature selection

被引:73
|
作者
Zhou, Nan [1 ,2 ]
Xu, Yangyang [3 ]
Cheng, Hong [1 ]
Fang, Jun [1 ]
Pedrycz, Witold [2 ,4 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Robot, Sch Automat Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[3] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
[4] King Abdulaziz Univ, Fac Engn, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
基金
加拿大自然科学与工程研究理事会;
关键词
Machine learning; Feature selection; Subspace learning; Unsupervised learning; DIMENSIONALITY REDUCTION; DISCRIMINANT; RECOVERY;
D O I
10.1016/j.patcog.2015.12.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global and local structures as the both of them contain important information. In this paper, we propose a global and local structure preserving sparse subspace learning (GLOSS) model for unsupervised feature selection. The model can simultaneously realize feature selection and subspace learning. In addition, we develop a greedy algorithm to establish a generic combinatorial model, and an iterative strategy based on an accelerated block coordinate descent is used to solve the GLoSS problem. We also provide whole iterate sequence convergence analysis of the proposed iterative algorithm. Extensive experiments are conducted on real-world datasets to show the superiority of the proposed approach over several state-of-the-art unsupervised feature selection approaches. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 101
页数:15
相关论文
共 50 条
  • [31] Feature selection by combining subspace learning with sparse representation
    Cheng, Debo
    Zhang, Shichao
    Liu, Xingyi
    Sun, Ke
    Zong, Ming
    MULTIMEDIA SYSTEMS, 2017, 23 (03) : 285 - 291
  • [32] Feature selection by combining subspace learning with sparse representation
    Debo Cheng
    Shichao Zhang
    Xingyi Liu
    Ke Sun
    Ming Zong
    Multimedia Systems, 2017, 23 : 285 - 291
  • [33] Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection
    Zhu, Xiaofeng
    Zhang, Shichao
    Hu, Rongyao
    Zhu, Yonghua
    Song, Jingkuan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (03) : 517 - 529
  • [34] Unsupervised Local and Global Weighting for Feature Selection
    Mesghouni, Nadia
    Ghedira, Khaled
    Temani, Moncef
    ADVANCES IN SWARM INTELLIGENCE, PT II, 2011, 6729 : 283 - 290
  • [35] Robust unsupervised feature selection via sparse and minimum-redundant subspace learning with dual regularization
    Zeng, Congying
    Chen, Hongmei
    Li, Tianrui
    Wan, Jihong
    NEUROCOMPUTING, 2022, 511 : 1 - 21
  • [36] UNSUPERVISED FEATURE SELECTION BY NONNEGATIVE SPARSITY ADAPTIVE SUBSPACE LEARNING
    Zhou, Nan
    Cheng, Hong
    Zheng, Ya-Li
    He, Liang-Tian
    Pedrycz, Witold
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION (ICWAPR), 2016, : 18 - 24
  • [37] Subspace learning for unsupervised feature selection via matrix factorization
    Wang, Shiping
    Pedrycz, Witold
    Zhu, Qingxin
    Zhu, William
    PATTERN RECOGNITION, 2015, 48 (01) : 10 - 19
  • [38] Feature selection for unsupervised learning through local learning
    Yao, Jin
    Mao, Qi
    Goodison, Steve
    Mai, Volker
    Sun, Yijun
    PATTERN RECOGNITION LETTERS, 2015, 53 : 100 - 107
  • [39] Unsupervised feature selection by combining subspace learning with feature self-representation
    Li, Yangding
    Lei, Cong
    Fang, Yue
    Hu, Rongyao
    Li, Yonggang
    Zhang, Shichao
    PATTERN RECOGNITION LETTERS, 2018, 109 : 35 - 43
  • [40] Global and local structure preserving nonnegative subspace clustering
    Jia, Hongjie
    Zhu, Dongxia
    Huang, Longxia
    Mao, Qirong
    Wang, Liangjun
    Song, Heping
    PATTERN RECOGNITION, 2023, 138