FedHLC: A Novel Federated Learning Algorithm Targeting Heterogeneous and Long-Tailed Data for Efficient Image Classification in Consumer Electronics

被引:0
|
作者
Qu, Zhiguo [1 ,2 ]
Liang, Zhiwei [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Engn Res Ctr Digital Forens, Minist Educ, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Classification algorithms; Consumer electronics; Training; Image classification; Feature extraction; Servers; Digital images; digital image classification; federated learning; heterogeneous data; long-tailed data;
D O I
10.1109/TCE.2024.3443022
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Federated learning (FL) is an effective technique for image classification in consumer electronics. This paper proposes a new FL algorithm called FedHLC to address heterogeneous and long-tailed data. Its architecture comprises a feature extractor and a classifier. The training process of FedHLC is divided into two distinct stages. In the first stage, it focuses on training feature extractors on the client side and conducts feature representation learning. This approach develops a robust and generalizable representation for digital image data. The second stage involves retraining the classifier on the server side with generated virtual features. This step not only safeguards client privacy but also effectively mitigates model bias towards tail categories. In addition, FedHLC incorporates a novel balancing factor that dynamically adjusts the influence of regularization term. It allows a flexible focus shift between global objectives and local objectives. The simulation experiments on benchmark datasets demonstrate that FedHLC outperforms the baseline algorithms including CReFF, FedAvg, FedProx and FedNova in terms of accuracy when dealing with heterogeneous and long-tailed data. Furthermore, FedHLC can not only achieve good convergence but also attain an accuracy peak of 89.24%, marking a substantial advancement in the field of FL for image classification in consumer electronics. The code is available at https://github.com/Kiritoliang/FedHLC.
引用
收藏
页码:7266 / 7278
页数:13
相关论文
共 26 条
  • [1] CLIP-Guided Federated Learning on Heterogeneous and Long-Tailed Data
    Shi, Jiangming
    Zheng, Shanshan
    Yin, Xiangbo
    Lu, Yang
    Xie, Yuan
    Qu, Yanyun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 13, 2024, : 14955 - 14963
  • [2] Multi-Level Personalized Federated Learning on Heterogeneous and Long-Tailed Data
    Zhang, Rongyu
    Chen, Yun
    Wu, Chenrui
    Wang, Fangxin
    Li, Bo
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 12396 - 12409
  • [3] Dynamic Adaptive Federated Learning on Local Long-Tailed Data
    Pu, Juncheng
    Fu, Xiaodong
    Dong, Hai
    Zhang, Pengcheng
    Liu, Li
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (06) : 3485 - 3498
  • [4] Federated Learning for Assigning Weights to Clients on Long-Tailed Data
    Li, Yang
    Li, Kan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 438 - 449
  • [5] Joint representation and classifier learning for long-tailed image classification
    Guan, Qingji
    Li, Zhuangzhuang
    Zhang, Jiayu
    Huang, Yaping
    Zhao, Yao
    IMAGE AND VISION COMPUTING, 2023, 137
  • [6] Logit Calibration for Non-IID and Long-Tailed Data in Federated Learning
    Wang, Huan
    Wang, Lijuan
    Shen, Jun
    Proceedings - 20th IEEE International Symposium on Parallel and Distributed Processing with Applications, 12th IEEE International Conference on Big Data and Cloud Computing, 12th IEEE International Conference on Sustainable Computing and Communications and 15th IEEE International Conference on Social Computing and Networking, ISPA/BDCloud/SocialCom/SustainCom 2022, 2022, : 782 - 789
  • [7] Logit Calibration for Non-IID and Long-Tailed Data in Federated Learning
    Wang, Huan
    Wang, Lijuan
    Shen, Jun
    2022 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING, ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM, 2022, : 782 - 789
  • [8] Federated Learning With Long-Tailed Data via Representation Unification and Classifier Rectification
    Huang, Wenke
    Liu, Yuxia
    Ye, Mang
    Chen, Jun
    Du, Bo
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 5738 - 5750
  • [9] Contrastive Learning based Hybrid Networks for Long-Tailed Image Classification
    Wang, Peng
    Han, Kai
    Wei, Xiu-Shen
    Zhang, Lei
    Wang, Lei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 943 - 952
  • [10] Personalized Federated Learning on long-tailed data via knowledge distillation and generated features
    Lv, Fengling
    Qian, Pinxin
    Lu, Yang
    Wang, Hanzi
    PATTERN RECOGNITION LETTERS, 2024, 186 : 178 - 183