Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss

被引:18
|
作者
Peng, Zhen [1 ,3 ]
Tian, Shengwei [1 ,3 ]
Yu, Long [2 ]
Zhang, Dezhi [4 ,5 ,6 ]
Wu, Weidong [4 ,5 ,6 ]
Zhou, Shaofeng [1 ,3 ]
机构
[1] Xinjiang Univ, Collage Software, Urumqi 830000, Peoples R China
[2] Xinjiang Univ, Network Ctr, Urumqi 830046, Peoples R China
[3] Xinjiang Univ, Key Lab Software Engn Technol, Urumqi 830000, Peoples R China
[4] Peoples Hosp Xinjiang Uygur Autonomous Reg, Dept Dermatol & Venereol, Urumqi 830000, Peoples R China
[5] Xinjiang Clin Res Ctr Dermatol Dis, Urumqi 830000, Peoples R China
[6] Xinjiang Key Lab Dermatol Res XJYS1707, Urumqi 830000, Peoples R China
关键词
Semi-supervised learning; Pseudo-labeling; Contrastive learning; Medical image classification;
D O I
10.1016/j.bspc.2022.104142
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Semi-supervised learning (SSL) may employ unlabeled data to improve model performance, which has great significance in medical imaging tasks. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in medical image datasets: (1) the models' predictions are biased toward the majority class in imbalanced datasets, and (2) discarding unlabeled data with confidence below the thresholds results in the loss of useful information. To solve these issues, we propose a novel SSL framework, FullMatch, which improves the model's performance by utilizing all unlabeled data. Specifically, we propose adaptive threshold pseudo-labeling (ATPL), a method for generating pseudo-labels based on the model's current learning status. ATPL dynamically adjusts the thresholds for each class during the training process, which can generate more pseudo-labels for classes with learning difficulties, thus alleviating the problem of data imbalance. Unlike existing semi-supervised methods based on pseudo-labeling, we do not discard unlabeled data with confidence below the thresholds. We propose an unreliable sample contrastive loss (USCL) to leverage useful information from unlabeled data with confidence below the thresholds by learning the similarities and differences between sample features. To eval-uate the performance of the proposed method, we conducted experiments on the ISIC 2018 skin lesion classi-fication dataset and the blood cell classification dataset. The experimental results show that our method outperforms the state-of-the-art SSL methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] SEMI-SUPERVISED 3D OBJECT DETECTION VIA ADAPTIVE PSEUDO-LABELING
    Xu, Hongyi
    Liu, Fengqi
    Zhou, Qianyu
    Hao, Jinkun
    Cao, Zhijie
    Feng, Zhengyang
    Ma, Lizhuang
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3183 - 3187
  • [22] Alternative Pseudo-Labeling for Semi-Supervised Automatic Speech Recognition
    Zhu H.
    Gao D.
    Cheng G.
    Povey D.
    Zhang P.
    Yan Y.
    IEEE/ACM Transactions on Audio Speech and Language Processing, 2023, 31 : 3320 - 3330
  • [23] Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning
    Arazo, Eric
    Ortego, Diego
    Albert, Paul
    O'Connor, Noel E.
    McGuinness, Kevin
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [24] Refined Semi-Supervised Modulation Classification: Integrating Consistency Regularization and Pseudo-Labeling Techniques
    Ma, Min
    Liu, Shanrong
    Wang, Shufei
    Shi, Shengnan
    FUTURE INTERNET, 2024, 16 (02)
  • [25] Spatial pseudo-labeling for semi-supervised facies classification (vol 195, 107834, 2020)
    Asghar, Saleem
    Choi, Junhwan
    Yoon, Daeung
    Byun, Joongmoo
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2021, 198
  • [26] JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Classification
    Zou, Henry Peng
    Caragea, Cornelia
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 7290 - 7301
  • [27] Discriminative and Contrastive Consistency for Semi-supervised Domain Adaptive Image Classification
    Fan, Yidan
    Lu, Wenhuan
    Han, Yahong
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1074 - 1079
  • [28] Pseudo-Labeling Using Gaussian Process for Semi-supervised Deep Learning
    Li, Zhun
    Ko, ByungSoo
    Choi, Hojin
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2018, : 263 - 269
  • [29] RCPS: Rectified Contrastive Pseudo Supervision for Semi-Supervised Medical Image Segmentation
    Zhao, Xiangyu
    Qi, Zengxin
    Wang, Sheng
    Wang, Qian
    Wu, Xuehai
    Mao, Ying
    Zhang, Lichi
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (01) : 251 - 261
  • [30] IMPROVED NOISY ITERATIVE PSEUDO-LABELING FOR SEMI-SUPERVISED SPEECH RECOGNITION
    Li, Tian
    Meng, Qingliang
    Sun, Yujian
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 167 - 173