Unsupervised feature selection via adaptive hypergraph regularized latent representation learning

被引:22
|
作者
Ding, Deqiong [1 ]
Yang, Xiaogao [2 ]
Xia, Fei [3 ]
Ma, Tiefeng [1 ]
Liu, Haiyun [4 ]
Tang, Chang [5 ]
机构
[1] Southwestern Univ Finance & Econ, Sch Stat, Chengdu 611130, Sichuan, Peoples R China
[2] Hunan Univ Arts & Sci, Coll Mech Engn, Changde 415000, Peoples R China
[3] Naval Univ Engn, NUDT, Opt Engn Postdoctoral Mobile Stn, Changsha 410073, Peoples R China
[4] Xuzhou Med Univ, Inst Cardiovasc Dis Res, Affiliated Huaian Hosp, Huaian 223100, Peoples R China
[5] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Unsupervised feature selection; Hypergraph learning; Latent representation learning; Local structure preservation; STRUCTURE PRESERVATION; GRAPH;
D O I
10.1016/j.neucom.2019.10.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the rapid development of multimedia technology, a large number of unlabelled data with high dimensionality need to be processed. The high dimensionality of data not only increases the computation burden of computer hardware, but also hinders algorithms to obtain optimal performance. Unsupervised feature selection, which is regarded as a means of dimensionality reduction, has been widely recognized as an important and challenging pre-step for many machine learning and data mining tasks. However, we observe that there are at least two issues in previous unsupervised feature selection methods. Firstly, traditional unsupervised feature selection algorithms usually assume that the data instances are identically distributed and there is no dependency between them. However, the data instances are not only associated with high dimensional features but also inherently interconnected with each other. Secondly, the traditional similarity graph used in previous methods can only describe the pair-wise relations of data, but cannot capture the high-order relations, so that the complex structures implied in the data cannot be sufficiently exploited. In this work, we propose a robust unsupervised feature selection method which embeds the latent representation learning into feature selection. Instead of measuring the feature importances in original data space, the feature selection is carried out in the learned latent representation space which is more robust to noises. In order to capture the local manifold geometrical structure of original data in a high-order manner, a hypergraph is adaptively learned and embedded into the resultant model. An efficient alternating algorithm is developed to optimize the problem. Experimental results on eight benchmark data sets demonstrate the effectiveness of the proposed method. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:79 / 97
页数:19
相关论文
共 50 条
  • [21] Precise feature selection via non-convex regularized graph embedding and self-representation for unsupervised learning
    Bai, Hanru
    Huang, Ming
    Zhong, Ping
    KNOWLEDGE-BASED SYSTEMS, 2024, 296
  • [22] Hypergraph Spectra for Unsupervised Feature Selection
    Zhang, Zhihong
    Hancock, Edwin R.
    STRUCTURAL, SYNTACTIC, AND STATISTICAL PATTERN RECOGNITION, 2012, 7626 : 620 - 628
  • [23] Joint sparse latent representation learning and dual manifold regularization for unsupervised feature selection
    Huang, Mengshi
    Chen, Hongmei
    Mi, Yong
    Luo, Chuan
    Horng, Shi-Jinn
    Li, Tianrui
    KNOWLEDGE-BASED SYSTEMS, 2023, 282
  • [24] Latent Space Embedding for Unsupervised Feature Selection via Joint Dictionary Learning
    Fan, Yang
    Dai, Jianhua
    Zhang, Qilai
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [25] Hypergraph regularized sparse feature learning
    Liu, Mingxia
    Zhang, Jun
    Guo, Xiaochun
    Cao, Liujuan
    NEUROCOMPUTING, 2017, 237 : 185 - 192
  • [26] Unsupervised Feature Selection with Graph Regularized Nonnegative Self-representation
    Yi, Yugen
    Zhou, Wei
    Cao, Yuanlong
    Liu, Qinghua
    Wang, Jianzhong
    BIOMETRIC RECOGNITION, 2016, 9967 : 591 - 599
  • [27] Subspace clustering via adaptive-loss regularized representation learning with latent affinities
    Jiang, Kun
    Zhu, Lei
    Liu, Zheng
    Sun, Qindong
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (01)
  • [28] Unsupervised Feature Selection via Local Structure Learning and Self-representation
    Zhang, Shichao
    Lei, Cong
    Fang, Yue
    Li, Yangding
    Hu, Rongyao
    Hu, Xiaoyi
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (IEEE ICBK 2017), 2017, : 297 - 302
  • [29] Unsupervised Feature Selection with Adaptive Structure Learning
    Du, Liang
    Shen, Yi-Dong
    KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 209 - 218
  • [30] Adaptive Graph Learning for Unsupervised Feature Selection
    Zhang, Zhihong
    Bai, Lu
    Liang, Yuanheng
    Hancock, Edwin R.
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT I, 2015, 9256 : 790 - 800