Granular-conditional-entropy-based attribute reduction for partially labeled data with proxy labels

被引:32
|
作者
Gao, Can [1 ,2 ]
Zhou, Jie [1 ,2 ]
Miao, Duoqian [3 ]
Yue, Xiaodong [4 ]
Wan, Jun [1 ,2 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, SZU Branch, Shenzhen 518060, Peoples R China
[3] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[4] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Rough sets; Semi-supervised attribute reduction; Conditional entropy; Information granularity; Proxy label; SUPERVISED FEATURE-SELECTION; ROUGH SET-THEORY; INFORMATION FUSION; DECISION;
D O I
10.1016/j.ins.2021.08.067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Attribute reduction is attracting considerable attention in the theory of rough sets, and thus many rough-set-based attribute reduction methods have been presented. However, most of them are specifically designed for either labeled or unlabeled data, whereas many real-world applications involve partial supervision. In this paper, we propose a rough-set based semi-supervised attribute reduction method for partially labeled data. Specifically, using prior class-distribution information, we first develop a simple yet effective strategy to produce proxy labels for unlabeled data. Then, the concept of information granularity is integrated into an information-theoretic measure, based on which, a novel granular conditional entropy measure is proposed, and its monotonicity is theoretically proved. Furthermore, a fast heuristic algorithm is provided to generate the optimal reduct of partially labeled data, which could accelerate the process of attribute reduction by removing irrelevant examples and simultaneously excluding redundant attributes. Extensive experiments conducted on UCI data sets demonstrate that the proposed semi-supervised attribute reduction method is promising and, in terms of classification performance, it even compares favorably with supervised methods on labeled and unlabeled data with true labels (Our code and experimental data are released at Mendeley Data https://doi.org/10. 17632/v3byhx2v8s.1). (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:111 / 128
页数:18
相关论文
共 50 条
  • [31] Attribute reduction based on fusion information entropy
    Ji, Xia
    Li, Jie
    Yao, Sheng
    Zhao, Peng
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2023, 160
  • [32] Attribute reduction based on improved information entropy
    Liang, Baohua
    Wang, Lin
    Liu, Yong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (01) : 709 - 718
  • [33] A heuristic reduction algorithm based on entropy of attribute
    Xinying C.
    Yuefan L.
    Journal of Convergence Information Technology, 2011, 6 (03) : 209 - 216
  • [34] Attribute reduction based on approximation decision entropy
    Jiang, Feng
    Wang, Sha-Sha
    Du, Jun-Wei
    Sui, Yue-Fei
    Kongzhi yu Juece/Control and Decision, 2015, 30 (01): : 65 - 70
  • [35] Attribute reduction based on improved information entropy
    Liang, Baohua
    Ruan, Fei
    Liu, Yun
    THIRD INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2018, 10828
  • [36] Attribute Reduction Based on the Minimum Hybrid Entropy
    Li, Fa-Chao
    Gao, Chao
    Jin, Chen-Xia
    ICNC 2008: FOURTH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 4, PROCEEDINGS, 2008, : 100 - +
  • [37] A Rough Set Algorithm for Attribute Reduction via Mutual Information and Conditional Entropy
    Tian, Jing
    Wang, Quan
    Yu, Bing
    Yu, Dan
    2013 10TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2013, : 567 - 571
  • [38] An Improved Attribute Reduction Algorithm based on Granular Computing
    Tang, X.
    Shu, L.
    INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2015, 10 (06) : 856 - 864
  • [39] Research on discretization of continuous attribute and attribute reduction based on united entropy
    Software Technology Institute, Dalian Jiaotong University, Dalian 116028, China
    不详
    Intl. J. Adv. Comput. Technolog., 2012, 18 (441-449):
  • [40] Attribute-Based Verifiable Conditional Proxy Re-Encryption Scheme
    Tang, Yongli
    Jin, Minglu
    Meng, Hui
    Yang, Li
    Zheng, Chengfu
    ENTROPY, 2023, 25 (05)