A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
|
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
  • [1] Prototype-based classifier learning for long-tailed visual recognition
    Xiu-Shen Wei
    Shu-Lin Xu
    Hao Chen
    Liang Xiao
    Yuxin Peng
    Science China Information Sciences, 2022, 65
  • [2] CLIP-Guided Federated Learning on Heterogeneous and Long-Tailed Data
    Shi, Jiangming
    Zheng, Shanshan
    Yin, Xiangbo
    Lu, Yang
    Xie, Yuan
    Qu, Yanyun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 13, 2024, : 14955 - 14963
  • [3] Prototype-based classifier learning for long-tailed visual recognition
    Xiu-Shen WEI
    Shu-Lin XU
    Hao CHEN
    Liang XIAO
    Yuxin PENG
    Science China(Information Sciences), 2022, 65 (06) : 62 - 76
  • [4] Prototype-based classifier learning for long-tailed visual recognition
    Wei, Xiu-Shen
    Xu, Shu-Lin
    Chen, Hao
    Xiao, Liang
    Peng, Yuxin
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (06)
  • [5] Federated Learning With Long-Tailed Data via Representation Unification and Classifier Rectification
    Huang, Wenke
    Liu, Yuxia
    Ye, Mang
    Chen, Jun
    Du, Bo
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 5738 - 5750
  • [6] Federated Long-Tailed Learning by Retraining the Biased Classifier with Prototypes
    Li, Yang
    Li, Kan
    FRONTIERS IN CYBER SECURITY, FCS 2023, 2024, 1992 : 575 - 585
  • [7] Improving Generalization and Personalization in Long-Tailed Federated Learning via Classifier Retraining
    Li, Yuhang
    Liu, Tong
    Shen, Wenfeng
    Cui, Yangguang
    Lu, Weijia
    EURO-PAR 2024: PARALLEL PROCESSING, PART II, EURO-PAR 2024, 2024, 14802 : 408 - 423
  • [8] Dynamic Adaptive Federated Learning on Local Long-Tailed Data
    Pu, Juncheng
    Fu, Xiaodong
    Dong, Hai
    Zhang, Pengcheng
    Liu, Li
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (06) : 3485 - 3498
  • [9] Federated Learning for Assigning Weights to Clients on Long-Tailed Data
    Li, Yang
    Li, Kan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 438 - 449
  • [10] Federated deep long-tailed learning: A survey
    Li, Kan
    Li, Yang
    Zhang, Ji
    Liu, Xin
    Ma, Zhichao
    NEUROCOMPUTING, 2024, 595