Unsupervised feature selection based on incremental forward iterative Laplacian score

被引:8
|
作者
Jiang, Jiefang [1 ,2 ]
Zhang, Xianyong [1 ,2 ,3 ]
Yang, Jilin [2 ,4 ]
机构
[1] Sichuan Normal Univ, Sch Math Sci, Chengdu 610066, Peoples R China
[2] Sichuan Normal Univ, Inst Intelligent Informat & Quantum Informat, Chengdu 610066, Peoples R China
[3] Sichuan Normal Univ, Natl Local Joint Engn Lab Syst Credibil Automat V, Res Ctr, Chengdu 610066, Peoples R China
[4] Sichuan Normal Univ, Coll Comp Sci, Chengdu 610101, Peoples R China
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Feature selection; Unsupervised learning; Forward iterative Laplacian score; Incremental forward iterative Laplacian score; Feature significance; Granulation nonmonotonicity and uncertainty; ATTRIBUTE REDUCTION;
D O I
10.1007/s10462-022-10274-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection facilitates intelligent information processing, and the unsupervised learning of feature selection has become important. In terms of unsupervised feature selection, the Laplacian score (LS) provides a powerful measurement and optimization method, and good performance has been achieved using the recent forward iterative Laplacian score (FILS) algorithm. However, there is still room for advancement. The aim of this paper is to improve the FILS algorithm, and thus, feature significance (SIG) is mainly introduced to develop a high-quality selection method, i.e., the incremental forward iterative Laplacian score (IFILS) algorithm. Based on the modified LS, the metric difference in the incremental feature process motivates SIG. Therefore, SIG offers a dynamic characterization by considering initial and terminal states, and it promotes the current FILS measurement on only the terminal state. Then, both the modified LS and integrated SIG acquire granulation nonmonotonicity and uncertainty, especially on incremental feature chains, and the corresponding verification is achieved by completing examples and experiments. Furthermore, a SIG-based incremental criterion of minimum selection is designed to choose optimization features, and thus, the IFILS algorithm is naturally formulated to implement unsupervised feature selection. Finally, an in-depth comparison of the IFILS algorithm with the FILS algorithm is achieved using data experiments on multiple datasets, including a nominal dataset of COVID-19 surveillance. As validated by the experimental results, the IFILS algorithm outperforms the FILS algorithm and achieves better classification performance.
引用
收藏
页码:4077 / 4112
页数:36
相关论文
共 50 条
  • [1] Unsupervised feature selection based on incremental forward iterative Laplacian score
    Jiefang Jiang
    Xianyong Zhang
    Jilin Yang
    Artificial Intelligence Review, 2023, 56 : 4077 - 4112
  • [2] Fast Backward Iterative Laplacian Score for Unsupervised Feature Selection
    Pang, Qing-Qing
    Zhang, Li
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 409 - 420
  • [3] Iterative Laplacian Score for Feature Selection
    Zhu, Linling
    Miao, Linsong
    Zhang, Daoqiang
    PATTERN RECOGNITION, 2012, 321 : 80 - 87
  • [4] Hierarchical Laplacian Score for unsupervised feature selection
    Nhat-Quang Doan
    Azzag, Hanane
    Lebbah, Mustapha
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018, : 765 - 771
  • [5] Differentiable Unsupervised Feature Selection based on a Gated Laplacian
    Lindenbaum, Ofir
    Shaham, Uri
    Peterfreund, Erez
    Svirsky, Jonathan
    Casey, Nicolas
    Kluger, Yuval
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] An Unsupervised Feature Selection Algorithm: Laplacian Score Combined with Distance-based Entropy Measure
    Liu, Rongye
    Yang, Ning
    Ding, Xiangqian
    Ma, Lintao
    2009 THIRD INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL 3, PROCEEDINGS, 2009, : 65 - +
  • [7] Univariate Filter Technique for Unsupervised Feature Selection Using a new Laplacian Score based Local Nearest Neighbors
    Padungweang, Praisan
    Lursinsap, Chidchanok
    Sunat, Khamron
    2009 ASIA-PACIFIC CONFERENCE ON INFORMATION PROCESSING (APCIP 2009), VOL 2, PROCEEDINGS, 2009, : 196 - +
  • [8] Unsupervised Feature Selection Using Correlation Score
    Pattanshetti, Tanuja
    Attar, Vahida
    COMPUTING, COMMUNICATION AND SIGNAL PROCESSING, ICCASP 2018, 2019, 810 : 355 - 362
  • [9] UNSUPERVISED FEATURE SELECTION USING INCREMENTAL LEAST SQUARES
    Liu, Rong
    Rallo, Robert
    Cohen, Yoram
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING, 2011, 10 (06) : 967 - 987
  • [10] A Fast Iterative Algorithm for Improved Unsupervised Feature Selection
    Ordozgoiti, Bruno
    Gomez Canaval, Sandra
    Mozo, Alberto
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 390 - 399