Integrated self-supervised label propagation for label imbalanced sets

被引:0
|
作者
Ge, Zeping [1 ]
Yang, Youlong [1 ]
Du, Zhenye [1 ]
机构
[1] Xidian Univ, Sch Math & Stat, Xinglong St, Xian 710126, Shaanxi, Peoples R China
关键词
Label propagation; Self-supervised learning; Label imbalanced set; Graph construction; GRAPH;
D O I
10.1007/s10489-024-05591-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Label propagation is an essential graph-based semi-supervised learning algorithm. However, the algorithm has two problems: how to effectively measure sample similarity and handle label imbalanced sets. Recent advances in the semi-supervised field have shown that self-supervised pre-training can help to model more explicit class boundaries and significantly improve classification accuracy. Inspired by the problems and progress, we propose an integrated self-supervised label propagation algorithm (ISSLP). Our algorithm's framework introduces self-supervised information in the iterative label propagation process to establish more explicit inter-class boundaries and control the label propagation scope. In addition, considering that different self-supervised models can capture different feature views of the data, we propose an entropy approach to measure the quality of feature views and generate weights for integrating multiple propagation results. The experimental results on synthetic and real-world datasets show that the proposed method can effectively solve the label imbalance problem and is insensitive to the parameters in the graph construction stage.
引用
收藏
页码:8525 / 8544
页数:20
相关论文
共 50 条
  • [1] Self-Supervised GANs with Label Augmentation
    Hou, Liang
    Shen, Huawei
    Cao, Qi
    Cheng, Xueqi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] Semi-supervised imbalanced multi-label classification with label propagation
    Du, Guodong
    Zhang, Jia
    Zhang, Ning
    Wu, Hanrui
    Wu, Peiliang
    Li, Shaozi
    PATTERN RECOGNITION, 2024, 150
  • [3] Incremental label propagation for data sets with imbalanced labels
    Li, Yaoxing
    Bai, Liang
    Liang, Zhuomin
    Du, Hangyuan
    NEUROCOMPUTING, 2023, 535 : 144 - 155
  • [4] Positional Label for Self-Supervised Vision Transformer
    Zhang, Zhemin
    Gong, Xun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3516 - 3524
  • [5] Self-supervised Label Augmentation via Input Transformations
    Lee, Hankook
    Hwang, Sung Ju
    Shin, Jinwoo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [6] Self-supervised knowledge distillation for complementary label learning
    Liu, Jiabin
    Li, Biao
    Lei, Minglong
    Shi, Yong
    NEURAL NETWORKS, 2022, 155 : 318 - 327
  • [7] Reducing Label Effort: Self-Supervised meets Active Learning
    Bengar, Javad Zolfaghari
    van de Weijer, Joost
    Twardowski, Bartlomiej
    Raducanu, Bogdan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1631 - 1639
  • [8] Investigating Self-Supervised Methods for Label-Efficient Learning
    Nandam, Srinivasa Rao
    Atito, Sara
    Feng, Zhenhua
    Kittler, Josef
    Awais, Muhammed
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [9] Multi-Label Self-Supervised Learning with Scene Images
    Zhu, Ke
    Fu, Minghao
    Wu, Jianxin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6671 - 6680
  • [10] Self-supervised Label-Visual Correlation Hashing for Multi-label Image Retrieval
    Liu, Yu
    Xie, Yanzhao
    Song, Jingkuan
    Wei, Rukai
    Zhou, Ke
    WEB AND BIG DATA, PT II, APWEB-WAIM 2022, 2023, 13422 : 129 - 143