A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
|
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
  • [31] Medical long-tailed learning for imbalanced data: Bibliometric analysis
    Wu, Zheng
    Guo, Kehua
    Luo, Entao
    Wang, Tian
    Wang, Shoujin
    Yang, Yi
    Zhu, Xiangyuan
    Ding, Rui
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 247
  • [32] Mutual Learning for Long-Tailed Recognition
    Park, Changhwa
    Yim, Junho
    Jun, Eunji
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2674 - 2683
  • [33] Deep Long-Tailed Learning: A Survey
    Zhang, Yifan
    Kang, Bingyi
    Hooi, Bryan
    Yan, Shuicheng
    Feng, Jiashi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10795 - 10816
  • [34] Reviving undersampling for long-tailed learning
    Yu, Hao
    Du, Yingxiao
    Wu, Jianxin
    PATTERN RECOGNITION, 2025, 161
  • [35] FedHLC: A Novel Federated Learning Algorithm Targeting Heterogeneous and Long-Tailed Data for Efficient Image Classification in Consumer Electronics
    Qu, Zhiguo
    Liang, Zhiwei
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 7266 - 7278
  • [36] ProCo: Prototype-Aware Contrastive Learning for Long-Tailed Medical Image Classification
    Yang, Zhixiong
    Pan, Junwen
    Yang, Yanzhan
    Shi, Xiaozhou
    Zhou, Hong-Yu
    Zhang, Zhicheng
    Bian, Cheng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VIII, 2022, 13438 : 173 - 182
  • [37] Federated learning on non-IID and globally long-tailed data via meta re-weighting networks
    Lu, Yang
    Qian, Pinxin
    Yan, Shanshan
    Huang, Gang
    Tang, Yuan Yan
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2024, 22 (03)
  • [38] Visualizing bivariate long-tailed data
    Dyer, Justin S.
    Owen, Art B.
    ELECTRONIC JOURNAL OF STATISTICS, 2011, 5 : 642 - 668
  • [39] PILoRA: Prototype Guided Incremental LoRA for Federated Class-Incremental Learning
    Guo, Haiyang
    Zhu, Fei
    Liu, Wenzhuo
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    COMPUTER VISION - ECCV 2024, PT LXV, 2025, 15123 : 141 - 159
  • [40] Long-Tailed Recognition by Hierarchical Rebalancing Dual-Classifier
    Zhang, Junsong
    Gao, Linsheng
    Li, Hao
    Zhou, Hao
    IEEE ACCESS, 2023, 11 : 54839 - 54848