A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
|
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
  • [21] Long-Tailed Partial Label Learning by Head Classifier and Tail Classifier Cooperation
    Jia, Yuheng
    Peng, Xiaorui
    Wang, Ran
    Zhang, Min-Ling
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12857 - 12865
  • [22] Joint representation and classifier learning for long-tailed image classification
    Guan, Qingji
    Li, Zhuangzhuang
    Zhang, Jiayu
    Huang, Yaping
    Zhao, Yao
    IMAGE AND VISION COMPUTING, 2023, 137
  • [23] Class Instance Balanced Learning for Long-Tailed Classification
    Lavoie, Marc-Antoine
    Waslander, Steven L.
    2023 20TH CONFERENCE ON ROBOTS AND VISION, CRV, 2023, : 121 - 128
  • [24] Federated learning on non-IID and long-tailed data via dual-decoupling
    Wang, Zhaohui
    Li, Hongjiao
    Li, Jinguo
    Hu, Renhao
    Wang, Baojin
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (05) : 728 - 741
  • [25] Propheter: Prophetic Teacher Guided Long-Tailed Distribution Learning
    Xu, Wenxiang
    Jing, Yongcheng
    Zhou, Linyun
    Huang, Wenqi
    Cheng, Lechao
    Feng, Zunlei
    Song, Mingli
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT IV, 2024, 14450 : 213 - 225
  • [26] Weight-guided class complementing for long-tailed image recognition
    Zhao, Xinqiao
    Xiao, Jimin
    Yu, Siyue
    Li, Hui
    Zhang, Bingfeng
    PATTERN RECOGNITION, 2023, 138
  • [27] Learning from Reduced Labels for Long-Tailed Data
    Wei, Meng
    Li, Zhongnian
    Zhou, Yong
    Xu, Xinzheng
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 111 - 119
  • [28] Geometric Prior Guided Feature Representation Learning for Long-Tailed Classification
    Ma, Yanbiao
    Jiao, Licheng
    Liu, Fang
    Yang, Shuyuan
    Liu, Xu
    Chen, Puhua
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (07) : 2493 - 2510
  • [29] Adaptive adapter routing for long-tailed class-incremental learning
    Qi, Zhi-Hong
    Zhou, Da-Wei
    Yao, Yiran
    Ye, Han-Jia
    Zhan, De-Chuan
    MACHINE LEARNING, 2025, 114 (03)
  • [30] Label-Noise Learning with Intrinsically Long-Tailed Data
    Lu, Yang
    Zhang, Yiliang
    Han, Bo
    Cheung, Yiu-Ming
    Wang, Hanzi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1369 - 1378