Uplink Scheduling in Federated Learning: an Importance-Aware Approach via Graph Representation Learning

被引:0
|
作者
Skocaj, Marco [1 ,2 ]
Rivera, Pedro Enrique Iturria [3 ]
Verdone, Roberto [1 ,2 ]
Erol-Kantarci, Melike [3 ]
机构
[1] Univ Bologna, DEI, Bologna, Italy
[2] CNIT, WiLab, Natl Lab Wireless Commun, Parma, Italy
[3] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON, Canada
关键词
Federated Learning; Graph Representation Learning; Scheduling; Communication-efficient FL; Energy-efficient FL; 6G; Spatial Correlation;
D O I
10.1109/ICCWORKSHOPS57953.2023.10283576
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) has emerged as a promising framework for distributed training of AI-based services, applications, and network procedures in 6G. One of the major challenges affecting the performance and efficiency of 6G wireless FL systems is the massive scheduling of user devices over resource-constrained channels. In this work, we argue that the uplink scheduling of FL client devices is a problem with a rich relational structure. To address this challenge, we propose a novel, energy-efficient, and importance-aware metric for client scheduling in FL applications by leveraging Unsupervised Graph Representation Learning (UGRL). Our proposed approach introduces a relational inductive bias in the scheduling process and does not require the collection of training feedback information from client devices, unlike state-of-the-art importance-aware mechanisms. We evaluate our proposed solution against baseline scheduling algorithms based on recently proposed metrics in the literature. Results show that, when considering scenarios of nodes exhibiting spatial relations, our approach can achieve an average gain of up to 10% in model accuracy and up to 17 times in energy efficiency compared to state-of-the-art importance-aware policies.
引用
收藏
页码:1014 / 1019
页数:6
相关论文
共 50 条
  • [1] Exploiting Diversity Via Importance-Aware User Scheduling For Fast Edge Learning
    Liu, Dongzhu
    Zhu, Guangxu
    Zhang, Jun
    Huang, Kaibin
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [2] FRAIM: A Feature Importance-Aware Incentive Mechanism for Vertical Federated Learning
    Tan, Lei
    Yang, Yunchao
    Hu, Miao
    Zhou, Yipeng
    Wu, Di
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2023, PT V, 2024, 14491 : 132 - 150
  • [3] Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) : 13593 - 13605
  • [4] Importance-aware data selection and resource allocation for hierarchical federated edge learning
    Qiang, Xianke
    Hu, Yun
    Chang, Zheng
    Hamalainen, Timo
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 154 : 35 - 44
  • [5] Importance-Aware Learning for Neural Headline Editing
    Wu, Qingyang
    Li, Lei
    Zhou, Hao
    Zeng, Ying
    Yu, Zhou
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9282 - 9289
  • [6] Importance-Aware Genetic Programming for Automated Scheduling Heuristics Learning in Dynamic Flexible Job Shop Scheduling
    Zhang, Fangfang
    Mei, Yi
    Nguyen, Su
    Zhang, Mengjie
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT II, 2022, 13399 : 48 - 62
  • [7] Importance-aware contrastive learning via semantically augmented instances for unsupervised sentence embeddings
    Ma, Xin
    Li, Hong
    Shi, Jiawen
    Zhang, Yi
    Long, Zhigao
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (09) : 2979 - 2990
  • [8] Importance-aware contrastive learning via semantically augmented instances for unsupervised sentence embeddings
    Xin Ma
    Hong Li
    Jiawen Shi
    Yi Zhang
    Zhigao Long
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2979 - 2990
  • [9] Importance-Aware Information Bottleneck Learning Paradigm for Lip Reading
    Sheng, Changchong
    Liu, Li
    Deng, Wanxia
    Bai, Liang
    Liu, Zhong
    Lao, Songyang
    Kuang, Gangyao
    Pietikainen, Matti
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6563 - 6574
  • [10] Importance- and Channel-Aware Scheduling in Cellular Federated Edge Learning
    Ren, Jinke
    He, Yinghui
    Wen, Dingzhu
    Yu, Guanding
    Huang, Kaibin
    Guo, Dongning
    2020 54TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2020, : 294 - 298