Multi-Granularity Federated Learning by Graph-Partitioning

被引:0
|
作者
Dai, Ziming [1 ,2 ]
Zhao, Yunfeng [1 ]
Qiu, Chao [1 ,2 ]
Wang, Xiaofei [1 ,2 ]
Yao, Haipeng [3 ]
Niyato, Dusit [4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[2] Guangdong Lab Artificial Intelligence & Digital Ec, Shenzhen 518000, Peoples R China
[3] Beijing Univ Posts & Telecommun, Informat & Commun Engn, Beijing 100876, Peoples R China
[4] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Blockchain-based federated learning; consortium blockchain; balanced graph partitioning; cross-granularity guid- ance; credit model; RESOURCE-ALLOCATION; INTELLIGENCE;
D O I
10.1109/TCC.2024.3494765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In edge computing, energy-limited distributed edge clients present challenges such as heterogeneity, high energy consumption, and security risks. Traditional blockchain-based federated learning (BFL) struggles to address all three of these challenges simultaneously. This article proposes a Graph-Partitioning Multi-Granularity Federated Learning method on a consortium blockchain, namely GP-MGFL. To reduce the overall communication overhead, we adopt a balanced graph partitioning algorithm while introducing observer and consensus nodes. This method groups clients to minimize high-cost communications and focuses on the guidance effect within each group, thereby ensuring effective guidance with reduced overhead. To fully leverage heterogeneity, we introduce a cross-granularity guidance mechanism. This mechanism involves fine-granularity models guiding coarse-granularity models to enhance the accuracy of the latter models. We also introduce a credit model to adjust the contribution of models to the global model dynamically and to dynamically select leaders responsible for model aggregation. Finally, we implement a prototype system on real physical hardware and compare it with several baselines. Experimental results show that the accuracy of the GP-MGFL algorithm is 5.6% higher than that of ordinary BFL algorithms. In addition, compared to other grouping methods, such as greedy grouping, the accuracy of the proposed method improves by about 1.5%. In scenarios with malicious clients, the maximum accuracy improvement reaches 11.1%. We also analyze and summarize the impact of grouping and the number of clients on the model, as well as the impact of this method on the inherent security of the blockchain itself.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [31] Which Matters Most in Making Fund Investment Decisions? A Multi-granularity Graph Disentangled Learning Framework
    Gan, Chunjing
    Hu, Binbin
    Huang, Bo
    Zhao, Tianyu
    Lin, Yingru
    Zhong, Wenliang
    Zhang, Zhiqiang
    Zhou, Jun
    Shi, Chuan
    PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 2516 - 2520
  • [32] Multi-granularity Signal Processing Method for Digital Twin Power Grids via Graph Representation Learning
    Han, Jinglin
    Feng, Xichun
    Zhao, Hui
    Chen, Zhiyong
    Hu, Ping
    TRAITEMENT DU SIGNAL, 2024, 41 (03) : 1263 - 1270
  • [33] An incremental graph-partitioning algorithm for entity resolution
    Tauer, Gregory
    Date, Ketan
    Nagi, Rakesh
    Sudit, Moises
    INFORMATION FUSION, 2019, 46 : 171 - 183
  • [34] Parallel graph-partitioning using the mob heuristic
    Soch, M
    Tvrdík, P
    Volf, M
    RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 1997, 1332 : 383 - 389
  • [35] Multi-granularity episodic contrastive learning for few-shot learning
    Zhu, Pengfei
    Zhu, Zhilin
    Wang, Yu
    Zhang, Jinglin
    Zhao, Shuai
    PATTERN RECOGNITION, 2022, 131
  • [36] Multi-granularity Fatigue in Recommendation
    Xie, Ruobing
    Ling, Cheng
    Zhang, Shaoliang
    Xia, Feng
    Lin, Leyu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4595 - 4599
  • [37] MINING: Multi-Granularity Network Alignment Based on Contrastive Learning
    Zhang, Zhongbao
    Gao, Shuai
    Su, Sen
    Sun, Li
    Chen, Ruiyang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12785 - 12798
  • [38] Multi-granularity Attribute Reduction
    Liang, Shaochen
    Liu, Keyu
    Chen, Xiangjian
    Wang, Pingxin
    Yang, Xibei
    ROUGH SETS, IJCRS 2018, 2018, 11103 : 61 - 72
  • [39] Multi-granularity for knowledge distillation
    Shao, Baitan
    Chen, Ying
    IMAGE AND VISION COMPUTING, 2021, 115 (115)
  • [40] Multi-granularity resource Reservations
    Saewong, S
    Rajkumar, R
    RTSS 2005: 26th IEEE International Real-Time Systems Symposium, Proceedings, 2005, : 143 - 153