Multi-Granularity Federated Learning by Graph-Partitioning

被引:0
|
作者
Dai, Ziming [1 ,2 ]
Zhao, Yunfeng [1 ]
Qiu, Chao [1 ,2 ]
Wang, Xiaofei [1 ,2 ]
Yao, Haipeng [3 ]
Niyato, Dusit [4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[2] Guangdong Lab Artificial Intelligence & Digital Ec, Shenzhen 518000, Peoples R China
[3] Beijing Univ Posts & Telecommun, Informat & Commun Engn, Beijing 100876, Peoples R China
[4] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Blockchain-based federated learning; consortium blockchain; balanced graph partitioning; cross-granularity guid- ance; credit model; RESOURCE-ALLOCATION; INTELLIGENCE;
D O I
10.1109/TCC.2024.3494765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In edge computing, energy-limited distributed edge clients present challenges such as heterogeneity, high energy consumption, and security risks. Traditional blockchain-based federated learning (BFL) struggles to address all three of these challenges simultaneously. This article proposes a Graph-Partitioning Multi-Granularity Federated Learning method on a consortium blockchain, namely GP-MGFL. To reduce the overall communication overhead, we adopt a balanced graph partitioning algorithm while introducing observer and consensus nodes. This method groups clients to minimize high-cost communications and focuses on the guidance effect within each group, thereby ensuring effective guidance with reduced overhead. To fully leverage heterogeneity, we introduce a cross-granularity guidance mechanism. This mechanism involves fine-granularity models guiding coarse-granularity models to enhance the accuracy of the latter models. We also introduce a credit model to adjust the contribution of models to the global model dynamically and to dynamically select leaders responsible for model aggregation. Finally, we implement a prototype system on real physical hardware and compare it with several baselines. Experimental results show that the accuracy of the GP-MGFL algorithm is 5.6% higher than that of ordinary BFL algorithms. In addition, compared to other grouping methods, such as greedy grouping, the accuracy of the proposed method improves by about 1.5%. In scenarios with malicious clients, the maximum accuracy improvement reaches 11.1%. We also analyze and summarize the impact of grouping and the number of clients on the model, as well as the impact of this method on the inherent security of the blockchain itself.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [1] MGFL: Multi-granularity Federated Learning in Edge Computing Systems
    Cai, Shangxuan
    Zhao, Yunfeng
    Liu, Zhicheng
    Qiu, Chao
    Wang, Xiaofei
    Hu, Qinghua
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 549 - 563
  • [2] Multi-Granularity Weighted Federated Learning for Heterogeneous Edge Computing
    Zhao, Yunfeng
    Qiu, Chao
    Cai, Shangxuan
    Liu, Zhicheng
    Wang, Yu
    Wang, Xiaofei
    Hu, Qinghua
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2025, 18 (01) : 270 - 287
  • [3] Multi-Granularity Contrastive Learning for Graph with Hierarchical Pooling
    Liu, Peishuo
    Zhou, Cangqi
    Liu, Xiao
    Zhang, Jing
    Li, Qianmu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 : 499 - 511
  • [4] Multi-Granularity Graph Model (MGGM)
    Ghobril, P
    Tohmé, S
    2005 Conference on Optical Network Design and Modelling, Proceedings: TOWARDS THE BROADBAND-FOR-ALL ERA, 2005, : 383 - 392
  • [5] PARALLELISM IN GRAPH-PARTITIONING
    SAVAGE, JE
    WLOKA, MG
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1991, 13 (03) : 257 - 272
  • [6] Multi-granularity Weighted Federated Learning in Heterogeneous Mobile Edge Computing Systems
    Cai, Shangxuan
    Zhao, Yunfeng
    Liu, Zhicheng
    Qiu, Chao
    Wang, Xiaofei
    Hu, Qinghua
    2022 IEEE 42ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2022), 2022, : 436 - 446
  • [7] Learning knowledge graph embedding with multi-granularity relational augmentation network
    Xue, Zengcan
    Zhang, Zhaoli
    Liu, Hai
    Yang, Shuoqiu
    Han, Shuyun
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 233
  • [8] Multi-Granularity Causal Structure Learning
    Liang, Jiaxuan
    Wang, Jun
    Yu, Guoxian
    Xia, Shuyin
    Wang, Guoyin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13727 - 13735
  • [9] Text-enhanced Multi-Granularity Temporal Graph Learning for Event Prediction
    Han, Xiaoxue
    Ning, Yue
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 171 - 180
  • [10] Learning multi-granularity features from multi-granularity regions for person re-identification
    Yang, Kaiwen
    Yang, Jiwei
    Tian, Xinmei
    NEUROCOMPUTING, 2021, 432 : 206 - 215