Agent Selection Framework for Federated Learning in Resource-Constrained Wireless Networks

被引:0
|
作者
Raftopoulou, Maria [2 ]
Da Silva, Jose Mairton B. [1 ]
Litjens, Remco [2 ,3 ]
Vincent Poor, H. [4 ]
Van Mieghem, Piet [2 ]
机构
[1] Uppsala University, Department of Information Technology, Uppsala,751 05, Sweden
[2] Delft University of Technology, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft,2628 CD, Netherlands
[3] Netherlands Organisation for Applied Scientific Research (TNO), Department of Networks, The Hague,2595 DA, Netherlands
[4] Princeton University, Department of Electrical and Computer Engineering, Princeton,NJ,08544, United States
关键词
Adversarial machine learning - Contrastive Learning - Polynomial approximation - Sensitive data;
D O I
10.1109/TMLCN.2024.3450829
中图分类号
学科分类号
摘要
Federated learning is an effective method to train a machine learning model without requiring to aggregate the potentially sensitive data of agents in a central server. However, the limited communication bandwidth, the hardware of the agents and a potential application-specific latency requirement impact how many and which agents can participate in the learning process at each communication round. In this paper, we propose a selection metric characterizing each agent's importance with respect to both the learning process and the resource efficiency of its wireless communication channel. Leveraging this importance metric, we formulate a general agent selection optimization problem, which can be adapted to different environments with latency or resource-oriented constraints. Considering an example wireless environment with latency constraints, the agent selection problem reduces to the 0/1 Knapsack problem, which we solve with a fully polynomial approximation. We then evaluate the agent selection policy in different scenarios, using extensive simulations for an example task of object classification of European traffic signs. The results indicate that agent selection policies which consider both learning and channel aspects provide benefits in terms of the attainable global model accuracy and/or the time needed to achieve a targeted accuracy level. However, in scenarios where agents have a limited number of data samples or where the latency requirement is very stringent, a pure learning-based agent selection policy is shown to be more beneficial during the early or late stages of the learning process. © 2023 CCBY.
引用
收藏
页码:1265 / 1282
相关论文
共 50 条
  • [41] Reinforcement Learning for Real-Time Federated Learning for Resource-Constrained Edge Cluster
    Rajashekar, Kolichala
    Paul, Souradyuti
    Karmakar, Sushanta
    Sidhanta, Subhajit
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2024, 32 (04)
  • [42] TRANSMISSION PROTOCOL SIMULATION FRAMEWORK FOR THE RESOURCE-CONSTRAINED WIRELESS SENSOR NETWORK
    Wojcikowski, Marek
    METROLOGY AND MEASUREMENT SYSTEMS, 2015, 22 (02) : 221 - 228
  • [43] Efficient federated learning on resource-constrained edge devices based on model pruning
    Wu, Tingting
    Song, Chunhe
    Zeng, Peng
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (06) : 6999 - 7013
  • [44] Communication-efficient asynchronous federated learning in resource-constrained edge computing
    Liu, Jianchun
    Xu, Hongli
    Xu, Yang
    Ma, Zhenguo
    Wang, Zhiyuan
    Qian, Chen
    Huang, He
    COMPUTER NETWORKS, 2021, 199
  • [45] Efficient federated learning on resource-constrained edge devices based on model pruning
    Tingting Wu
    Chunhe Song
    Peng Zeng
    Complex & Intelligent Systems, 2023, 9 : 6999 - 7013
  • [46] Federated Collaborative Learning with Sparse Gradients for Heterogeneous Data on Resource-Constrained Devices
    Li, Mengmeng
    He, Xin
    Chen, Jinhua
    ENTROPY, 2024, 26 (12)
  • [47] FogFL: Fog-Assisted Federated Learning for Resource-Constrained IoT Devices
    Saha, Rituparna
    Misra, Sudip
    Deb, Pallav Kumar
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (10) : 8456 - 8463
  • [48] Divide-and-conquer the NAS puzzle in resource-constrained federated learning systems
    Venkatesha, Yeshwanth
    Kim, Youngeun
    Park, Hyoungseob
    Panda, Priyadarshini
    NEURAL NETWORKS, 2023, 168 : 569 - 579
  • [49] Efficient Privacy-Preserving Federated Learning for Resource-Constrained Edge Devices
    Wu, Jindi
    Xia, Qi
    Li, Qun
    2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021), 2021, : 191 - 198
  • [50] Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environments
    Song, Rui
    Liu, Dai
    Chen, Dave Zhenyu
    Festag, Andreas
    Trinitis, Carsten
    Schulz, Martin
    Knoll, Alois
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,