Global and local structure preserving sparse subspace learning: An iterative approach to unsupervised feature selection

被引:73
|
作者
Zhou, Nan [1 ,2 ]
Xu, Yangyang [3 ]
Cheng, Hong [1 ]
Fang, Jun [1 ]
Pedrycz, Witold [2 ,4 ,5 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Robot, Sch Automat Engn, Chengdu 611731, Sichuan, Peoples R China
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[3] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
[4] King Abdulaziz Univ, Fac Engn, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
[5] Polish Acad Sci, Syst Res Inst, PL-01447 Warsaw, Poland
基金
加拿大自然科学与工程研究理事会;
关键词
Machine learning; Feature selection; Subspace learning; Unsupervised learning; DIMENSIONALITY REDUCTION; DISCRIMINANT; RECOVERY;
D O I
10.1016/j.patcog.2015.12.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As we aim at alleviating the curse of high-dimensionality, subspace learning is becoming more popular. Existing approaches use either information about global or local structure of the data, and few studies simultaneously focus on global and local structures as the both of them contain important information. In this paper, we propose a global and local structure preserving sparse subspace learning (GLOSS) model for unsupervised feature selection. The model can simultaneously realize feature selection and subspace learning. In addition, we develop a greedy algorithm to establish a generic combinatorial model, and an iterative strategy based on an accelerated block coordinate descent is used to solve the GLoSS problem. We also provide whole iterate sequence convergence analysis of the proposed iterative algorithm. Extensive experiments are conducted on real-world datasets to show the superiority of the proposed approach over several state-of-the-art unsupervised feature selection approaches. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:87 / 101
页数:15
相关论文
共 50 条
  • [41] Feature selection active learning algorithm based on sparse subspace
    Gong, Liang
    Wang, Xu-Hong
    Yang, Yu-Pu
    Journal of Computers (Taiwan), 2021, 32 (02) : 23 - 32
  • [42] Unsupervised feature selection using sparse manifold learning: Auto-encoder approach
    Moslemi, Amir
    Jamshidi, Mina
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (01)
  • [43] Subspace Sparse Discriminative Feature Selection
    Nie, Feiping
    Wang, Zheng
    Tian, Lai
    Wang, Rong
    Li, Xuelong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (06) : 4221 - 4233
  • [44] Unsupervised Feature Selection via Local Structure Learning and Self-representation
    Zhang, Shichao
    Lei, Cong
    Fang, Yue
    Li, Yangding
    Hu, Rongyao
    Hu, Xiaoyi
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (IEEE ICBK 2017), 2017, : 297 - 302
  • [45] Joint self-representation and subspace learning for unsupervised feature selection
    Ruili Wang
    Ming Zong
    World Wide Web, 2018, 21 : 1745 - 1758
  • [46] Using Sparse Learning for Feature Selection with Locality Structure Preserving based on Positive Data
    Noorie, Zahir
    Afsari, Fatemeh
    2018 6TH IRANIAN JOINT CONGRESS ON FUZZY AND INTELLIGENT SYSTEMS (CFIS), 2018, : 50 - 53
  • [47] Unsupervised feature selection based on adaptive similarity learning and subspace clustering
    Parsa, Mohsen Ghassemi
    Zare, Hadi
    Ghatee, Mehdi
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 95 (95)
  • [48] Nonnegative Laplacian embedding guided subspace learning for unsupervised feature selection
    Zhang, Yong
    Wang, Qing
    Gong, Dun-wei
    Song, Xian-fang
    PATTERN RECOGNITION, 2019, 93 : 337 - 352
  • [49] SPARSE REPRESENTATION-BASED APPROACH FOR UNSUPERVISED FEATURE SELECTION
    Su, Ya-Ru
    Li, Chuan-Xi
    Wang, Ru-Jing
    Chen, Peng
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2014, 28 (03)
  • [50] Joint self-representation and subspace learning for unsupervised feature selection
    Wang, Ruili
    Zong, Ming
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2018, 21 (06): : 1745 - 1758