Age of Information Based Client Selection for Wireless Federated Learning With Diversified Learning Capabilities

被引:0
|
作者
Dong, Liran [1 ,2 ,3 ]
Zhou, Yiqing [1 ,2 ,3 ]
Liu, Ling [1 ,2 ,3 ]
Qi, Yanli [1 ,2 ,3 ]
Zhang, Yu [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Processors, Beijing 100190, Peoples R China
[2] Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Training; Computational modeling; Servers; Data models; Wireless communication; Mobile computing; Accuracy; Federated learning (FL); age of information (AoI); client selection; fairness scheduling; COMMUNICATION; CONVERGENCE; DEVICES; DESIGN;
D O I
10.1109/TMC.2024.3450549
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) empowers wireless intelligent applications, by leveraging distributed data of edge clients for training without compromising privacy. Client selection is inevitable in FL, since clients have diversified learning capabilities arising from heterogeneous computing and communication resources. Existing methods like fair-selection and dropping-straggler are either inefficient or unfair (resulting in a less effective trained model). Therefore, we propose FedAoI, an Age-of-Information (AoI) based client selection policy. FedAoI ensures fairness by allowing all clients, including stragglers, to submit their model updates while maintaining high training efficiency by keeping round completion times short. This trade-off is achieved by minimizing Peak-AoI (PAoI), the interval between a client's consecutive participations. An optimization problem is formulated by minimizing the Expected-Weighted-Sum-of-PAoI. This NP-hard problem is addressed with a two-step sub-optimal algorithm, PriorS. It first calculates client priority in a round using Lyapunov optimization and then selects the highest-priority clients through G-FPFC (Greedy minimization of the round weighted-sum-of-PAoI with First-Priority-First-Considered). Simulation results demonstrate that, compared to fair-selection, FedAoI improves average efficiency by 83.8% and achieves an average model accuracy of 97.3% (or at the cost of averaging 2.7% degradation in model accuracy). Compared to dropping-straggler, FedAoI reduces the average model accuracy degradation from 9.5% to 2.7%.
引用
收藏
页码:14934 / 14945
页数:12
相关论文
共 50 条
  • [21] Blockchain-based Secure Client Selection in Federated Learning
    Nguyen, Truc
    Thai, Phuc
    Jeter, Tre R.
    Dinht, Thang N.
    Thai, My T.
    2022 IEEE INTERNATIONAL CONFERENCE ON BLOCKCHAIN AND CRYPTOCURRENCY (IEEE ICBC 2022), 2022,
  • [22] FedBoost: Bayesian Estimation Based Client Selection for Federated Learning
    Sheng, Yuhang
    Zeng, Lingguo
    Cao, Shuqin
    Dai, Qing
    Yang, Shasha
    Lu, Jianfeng
    IEEE ACCESS, 2024, 12 : 52255 - 52266
  • [23] Client Selection with Bandwidth Allocation in Federated Learning
    Kuang, Junqian
    Yang, Miao
    Zhu, Hongbin
    Qian, Hua
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [24] Towards Client Selection in Satellite Federated Learning
    Wu, Changhao
    He, Siyang
    Yin, Zengshan
    Guo, Chongbin
    APPLIED SCIENCES-BASEL, 2024, 14 (03):
  • [25] A review on client selection models in federated learning
    Panigrahi, Monalisa
    Bharti, Sourabh
    Sharma, Arun
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2023, 13 (06)
  • [26] Active Client Selection for Clustered Federated Learning
    Huang, Honglan
    Shi, Wei
    Feng, Yanghe
    Niu, Chaoyue
    Cheng, Guangquan
    Huang, Jincai
    Liu, Zhong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16424 - 16438
  • [27] Active Client Selection for Clustered Federated Learning
    Huang, Honglan
    Shi, Wei
    Feng, Yanghe
    Niu, Chaoyue
    Cheng, Guangquan
    Huang, Jincai
    Liu, Zhong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (11) : 16424 - 16438
  • [28] A Review of Client Selection Methods in Federated Learning
    Mayhoub S.
    M. Shami T.
    Archives of Computational Methods in Engineering, 2024, 31 (02) : 1129 - 1152
  • [29] Client Selection for Federated Learning With Label Noise
    Yang, Miao
    Qian, Hua
    Wang, Ximin
    Zhou, Yong
    Zhu, Honghin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (02) : 2193 - 2197
  • [30] GraphCS: Graph-based client selection for heterogeneity in federated learning
    Chang, Tao
    Li, Li
    Wu, MeiHan
    Yu, Wei
    Wang, Xiaodong
    Xu, ChengZhong
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2023, 177 : 131 - 143