Granular-conditional-entropy-based attribute reduction for partially labeled data with proxy labels

被引:32
|
作者
Gao, Can [1 ,2 ]
Zhou, Jie [1 ,2 ]
Miao, Duoqian [3 ]
Yue, Xiaodong [4 ]
Wan, Jun [1 ,2 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, SZU Branch, Shenzhen 518060, Peoples R China
[3] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[4] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Rough sets; Semi-supervised attribute reduction; Conditional entropy; Information granularity; Proxy label; SUPERVISED FEATURE-SELECTION; ROUGH SET-THEORY; INFORMATION FUSION; DECISION;
D O I
10.1016/j.ins.2021.08.067
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Attribute reduction is attracting considerable attention in the theory of rough sets, and thus many rough-set-based attribute reduction methods have been presented. However, most of them are specifically designed for either labeled or unlabeled data, whereas many real-world applications involve partial supervision. In this paper, we propose a rough-set based semi-supervised attribute reduction method for partially labeled data. Specifically, using prior class-distribution information, we first develop a simple yet effective strategy to produce proxy labels for unlabeled data. Then, the concept of information granularity is integrated into an information-theoretic measure, based on which, a novel granular conditional entropy measure is proposed, and its monotonicity is theoretically proved. Furthermore, a fast heuristic algorithm is provided to generate the optimal reduct of partially labeled data, which could accelerate the process of attribute reduction by removing irrelevant examples and simultaneously excluding redundant attributes. Extensive experiments conducted on UCI data sets demonstrate that the proposed semi-supervised attribute reduction method is promising and, in terms of classification performance, it even compares favorably with supervised methods on labeled and unlabeled data with true labels (Our code and experimental data are released at Mendeley Data https://doi.org/10. 17632/v3byhx2v8s.1). (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:111 / 128
页数:18
相关论文
共 50 条
  • [41] An Approximate Reduction Algorithm Based on Conditional Entropy
    Liu, Baoxiang
    Li, Ying
    Li, Lihong
    Yu, Yaping
    INFORMATION COMPUTING AND APPLICATIONS, PT 2, 2010, 106 : 319 - +
  • [42] A Knowledge Reduction Algorithm Based on Conditional Entropy
    YU Hong 1
    2.Institute of Computer Science & Engineering
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2001, (03) : 23 - 27
  • [43] Information Entropy-Based Attribute Reduction for Incomplete Set-Valued Data
    Zhang, Yuanxia
    Chen, Zuozan
    IEEE ACCESS, 2022, 10 : 8864 - 8882
  • [44] Attribute selection based on a new conditional entropy for incomplete decision systems
    Dai, Jianhua
    Wang, Wentao
    Tian, Haowei
    Liu, Liang
    KNOWLEDGE-BASED SYSTEMS, 2013, 39 : 207 - 213
  • [45] Entropy Based Attribute Reduction Algorithms for Rough Sets
    Yan, Hua
    MATERIALS, MECHANICAL ENGINEERING AND MANUFACTURE, PTS 1-3, 2013, 268-270 : 1859 - 1862
  • [46] Attribute Reduction Based on Fractal Dimension and Joint Entropy
    Li, Hong-qi
    Xu, Qing-song
    Zhu, Li-ping
    Yang, Zhong-guo
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SOFTWARE ENGINEERING (AISE 2014), 2014, : 350 - 354
  • [47] Algorithm Study of Attribute Reduction Based On Information Entropy
    Shao Liang-shan
    Wang Bin-tao
    Wang Jun
    Han Yu-min
    SEVENTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS I-III: UNLOCKING THE FULL POTENTIAL OF GLOBAL TECHNOLOGY, 2008, : 1204 - 1208
  • [48] Attribute reduction algorithm based on new conditional information quantity
    Inst. of Computer Science and Engineering, Jiangsu Teachers Univ. of Technology, Changzhou 213001, China
    不详
    不详
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2007, 29 (12): : 2154 - 2157
  • [49] An efficient and complete attribute reduction algorithm based on knowledge granular
    Zhao, Jie
    Xiao, Nan-Feng
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2009, 40 (06): : 1623 - 1629
  • [50] A New Attribute Reduction Recursive Algorithm Based On Granular Computing
    Li, Daoguo
    Chen, Zhaoxia
    Yin, Jie
    JOURNAL OF COMPUTERS, 2013, 8 (03) : 630 - 637