Incentive Mechanism Design for Multi-Round Federated Learning With a Single Budget

被引:0
|
作者
Ren, Zhihao [1 ]
Zhang, Xinglin [1 ]
Ng, Wing W. Y. [1 ]
Zhang, Junna [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Henan Normal Univ, Sch Comp & Informat Engn, Xinxiang 453007, Peoples R China
关键词
Accuracy; Computational modeling; Federated learning; Costs; Training; Mechanism design; Internet of Things; Data models; Performance evaluation; Analytical models; Auction; federated learning; incentive mechanism; non-IID; multi-round;
D O I
10.1109/TNSE.2024.3488719
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a popular distributed learning paradigm. In practical applications, FL faces two major challenges: (1) Participants inevitably incur computational and communication costs during training, which may discourage their participation; (2) The local data of participants is usually non-IID, which significantly affects the global model's performance. To address these challenges, in this paper, we model the FL incentive processas a budget-constrained cumulative quality maximization problem (BCQM). Unlike most existing works that focus on a single round of FL, BCQM fully encompasses the entire multi-round FL process with a single budget. Then, we propose a comprehensive incentive mechanism named Reverse Auction for Budget-constrained nOn-IID fedeRated learNing (RABORN) to solve BCQM. RABORN covers the entire FL process while ensuring several desirable properties. We also prove RABORN's theoretical performance. Moreover, compared to baselines on real-world datasets, RABORN exhibits significant advantages. Specifically, on MNIST, Fashion-MNIST, and CIFAR-10, RABORN achieves final accuracies that are respectively 2.94%, 5.94%, and 21.75% higher than baselines. Correspondingly, when the final model accuracies on MNIST, Fashion-MNIST, and CIFAR-10 converge to 80%, 70%, and 40%, RABORN reduces communication rounds by over 33%, 45%, and 74% compared to baselines, while increasing the remaining budget by over 30%, 19%, and 130%, respectively.
引用
收藏
页码:198 / 209
页数:12
相关论文
共 50 条
  • [1] On Multi-Round Privacy in Federated Learning
    Deer, August
    Ali, Ramy E.
    Avestimehr, A. Salman
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 764 - 769
  • [2] Flamingo: Multi-Round Single-Server Secure Aggregation with Applications to Private Federated Learning
    Ma, Yiping
    Woods, Jess
    Angel, Sebastian
    Polychroniadou, Antigoni
    Rabin, Tal
    2023 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP, 2023, : 477 - 496
  • [3] A Survey of Incentive Mechanism Design for Federated Learning
    Zhan, Yufeng
    Zhang, Jie
    Hong, Zicong
    Wu, Leijie
    Li, Peng
    Guo, Song
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2022, 10 (02) : 1035 - 1044
  • [4] Incentive Mechanism Design for Federated Learning and Unlearning
    Ding, Ningning
    Sun, Zhenyu
    Wei, Ermin
    Berry, Randall
    PROCEEDINGS OF THE 2023 INTERNATIONAL SYMPOSIUM ON THEORY, ALGORITHMIC FOUNDATIONS, AND PROTOCOL DESIGN FOR MOBILE NETWORKS AND MOBILE COMPUTING, MOBIHOC 2023, 2023, : 11 - 20
  • [5] Incentive Mechanism Design for Vertical Federated Learning
    Yang, Ni
    Cheung, Man Hon
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 3054 - 3059
  • [6] Multi-Round Incentive Mechanism for Cold Start-Enabled Mobile Crowdsensing
    Lin, Yaguang
    Cai, Zhipeng
    Wang, Xiaoming
    Hao, Fei
    Wang, Liang
    Sai, Akshita Maradapu Vera Venkata
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (01) : 993 - 1007
  • [7] Federated Learning with Fair Worker Selection: A Multi-Round Submodular Maximization Approach
    Li, Fengjiao
    Liu, Jia
    Ji, Bo
    2021 IEEE 18TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2021), 2021, : 180 - 188
  • [8] Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning
    So, Jinhyun
    Ali, Ramy E.
    Guler, Basak
    Jiao, Jiantao
    Avestimehr, A. Salman
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9864 - 9873
  • [9] Incentive Mechanism Design For Federated Learning in Multi-access Edge Computing
    Liu, Jingyuan
    Chang, Zheng
    Min, Geyong
    Han, Zhu
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3454 - 3459
  • [10] Incentive Mechanism Design for Federated Learning with Multi-Dimensional Private Information
    Ding, Ningning
    Fang, Zhixuan
    Huang, Jianwei
    2020 18TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), 2020,