General Class-Balanced Multicentric Dynamic Prototype Pseudo-Labeling for Source-Free Domain Adaptation

被引:0
|
作者
Qu, Sanqing [1 ]
Chen, Guang [1 ]
Zhang, Jing [2 ]
Li, Zhijun [1 ]
He, Wei [3 ]
Tao, Dacheng [4 ]
机构
[1] Tongji Univ, Shanghai, Peoples R China
[2] Univ Sydney, Sydney, Australia
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
[4] Nanyang Technol Univ, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Source-free domain adaptation; Class-balanced sampling; Multicentric prototype clustering; Pseudo-labeling;
D O I
10.1007/s11263-024-02335-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Source-free Domain Adaptation aims to adapt a pre-trained source model to an unlabeled target domain while circumventing access to well-labeled source data. To compensate for the absence of source data, most existing approaches employ prototype-based pseudo-labeling strategies to facilitate self-training model adaptation. Nevertheless, these methods commonly rely on instance-level predictions for direct monocentric prototype construction, leading to category bias and noisy labels. This is primarily due to the inherent visual domain gaps that often differ across categories. Besides, the monocentric prototype design is ineffective and may introduce negative transfer for those ambiguous data. To tackle these challenges, we propose a general class-Balanced Multicentric Dynamic (BMD) prototype strategy. Specifically, we first introduce a global inter-class balanced sampling strategy for each target category to mitigate category bias. Subsequently, we design an intra-class multicentric clustering strategy to generate robust and representative prototypes. In contrast to existing approaches that only update pseudo-labels at fixed intervals, e.g., one epoch, we employ a dynamic pseudo-labeling strategy that incorporates network update information throughout the model adaptation. We refer to the vanilla implementation of these three sub-strategies as BMD-v1. Furthermore, we promote the BMD-v1 to BMD-v2 by incorporating a consistency-guided reweighting strategy to improve inter-class balanced sampling, and leveraging the silhouettes metric to realize adaptive intra-class multicentric clustering. Extensive experiments conducted on both 2D images and 3D point cloud recognition demonstrate that our proposed BMD strategy significantly improves existing representative methods. Remarkably, BMD-v2 improves NRC from 52.6 to 59.2% in accuracy on the PointDA-10 benchmark. The code will be available at https://github.com/ispc-lab/BMD.
引用
收藏
页数:22
相关论文
共 30 条
  • [1] BMD: A General Class-Balanced Multicentric Dynamic Prototype Strategy for Source-Free Domain Adaptation
    Qu, Sanqing
    Chen, Guang
    Zhang, Jing
    Li, Zhijun
    He, Wei
    Tao, Dacheng
    COMPUTER VISION, ECCV 2022, PT XXXIV, 2022, 13694 : 165 - 182
  • [2] Multicentric prototype and pseudo-labeling based source-free domain adaptation for Alzheimer's disease classification
    Zhang, Qiongmin
    Cai, Hongshun
    Long, Ying
    Yu, Siyi
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 103
  • [3] Source-free domain adaptation with Class Prototype Discovery
    Zhou, Lihua
    Li, Nianxin
    Ye, Mao
    Zhu, Xiatian
    Tang, Song
    PATTERN RECOGNITION, 2023, 145
  • [4] Source-Free Domain Adaptive Fundus Image Segmentation with Denoised Pseudo-Labeling
    Chen, Cheng
    Liu, Quande
    Jin, Yueming
    Dou, Qi
    Heng, Pheng-Ann
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT V, 2021, 12905 : 225 - 235
  • [5] Source-free domain adaptation via dynamic pseudo labeling and Self-supervision
    Ma, Qiankun
    Zeng, Jie
    Zhang, Jianjia
    Zu, Chen
    Wu, Xi
    Zhou, Jiliu
    Chen, Jie
    Wang, Yan
    PATTERN RECOGNITION, 2024, 156
  • [6] Semi-Supervised Multimodal Emotion Recognition with Class-Balanced Pseudo-Labeling
    Chen, Haifeng
    Guo, Chujia
    Li, Yan
    Zhang, Peng
    Jiang, Dongmei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9556 - 9560
  • [7] Source-free domain adaptive segmentation with class-balanced complementary self-training
    Huang, Yongsong
    Xie, Wanqing
    Li, Mingzhen
    Xiao, Ethan
    You, Jane
    Liu, Xiaofeng
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2023, 146
  • [8] Source-Free Domain Adaptive Fundus Image Segmentation with Class-Balanced Mean Teacher
    Tang, Longxiang
    Li, Kai
    He, Chunming
    Zhang, Yulun
    Li, Xiu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT I, 2023, 14220 : 684 - 694
  • [9] ADAPTIVE PSEUDO LABELING FOR SOURCE-FREE DOMAIN ADAPTATION IN MEDICAL IMAGE SEGMENTATION
    Li, Chen
    Chen, Wei
    Luo, Xin
    He, Yulin
    Tan, Yusong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1091 - 1095
  • [10] Revisiting Domain-Adaptive 3D Object Detection by Reliable, Diverse and Class-balanced Pseudo-Labeling
    Chen, Zhuoxiao
    Luo, Yadan
    Wang, Zheng
    Baktashmotlagh, Mahsa
    Huang, Zi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3691 - 3703