Multi-Granularity Federated Learning by Graph-Partitioning

被引:0
|
作者
Dai, Ziming [1 ,2 ]
Zhao, Yunfeng [1 ]
Qiu, Chao [1 ,2 ]
Wang, Xiaofei [1 ,2 ]
Yao, Haipeng [3 ]
Niyato, Dusit [4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[2] Guangdong Lab Artificial Intelligence & Digital Ec, Shenzhen 518000, Peoples R China
[3] Beijing Univ Posts & Telecommun, Informat & Commun Engn, Beijing 100876, Peoples R China
[4] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Blockchain-based federated learning; consortium blockchain; balanced graph partitioning; cross-granularity guid- ance; credit model; RESOURCE-ALLOCATION; INTELLIGENCE;
D O I
10.1109/TCC.2024.3494765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In edge computing, energy-limited distributed edge clients present challenges such as heterogeneity, high energy consumption, and security risks. Traditional blockchain-based federated learning (BFL) struggles to address all three of these challenges simultaneously. This article proposes a Graph-Partitioning Multi-Granularity Federated Learning method on a consortium blockchain, namely GP-MGFL. To reduce the overall communication overhead, we adopt a balanced graph partitioning algorithm while introducing observer and consensus nodes. This method groups clients to minimize high-cost communications and focuses on the guidance effect within each group, thereby ensuring effective guidance with reduced overhead. To fully leverage heterogeneity, we introduce a cross-granularity guidance mechanism. This mechanism involves fine-granularity models guiding coarse-granularity models to enhance the accuracy of the latter models. We also introduce a credit model to adjust the contribution of models to the global model dynamically and to dynamically select leaders responsible for model aggregation. Finally, we implement a prototype system on real physical hardware and compare it with several baselines. Experimental results show that the accuracy of the GP-MGFL algorithm is 5.6% higher than that of ordinary BFL algorithms. In addition, compared to other grouping methods, such as greedy grouping, the accuracy of the proposed method improves by about 1.5%. In scenarios with malicious clients, the maximum accuracy improvement reaches 11.1%. We also analyze and summarize the impact of grouping and the number of clients on the model, as well as the impact of this method on the inherent security of the blockchain itself.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [21] Multi-granularity network representation learning on overlapping communities
    Zhou, Rongrong
    Li, Jinhai
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (07) : 2935 - 2955
  • [22] A review on network representation learning with multi-granularity perspective
    Fu, Shun
    Wang, Lufeng
    Yang, Jie
    INTELLIGENT DATA ANALYSIS, 2024, 28 (01) : 3 - 32
  • [23] Multi-Granularity Decomposition for Componentized Multimedia Applications based on Graph Clustering
    Wang, Ziliang
    Zhou, Fanqin
    Feng, Lei
    Li, Wenjing
    2021 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2021,
  • [24] MULTI-GRANULARITY HETEROGENEOUS GRAPH FOR DOCUMENT-LEVEL RELATION EXTRACTION
    Tang, Hengzhu
    Cao, Yanan
    Zhang, Zhenyu
    Jia, Ruipeng
    Fang, Fang
    Wang, Shi
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7683 - 7687
  • [25] A multi-granularity grid-based graph model for indoor space
    1600, Science and Engineering Research Support Society (09):
  • [26] Multi-granularity Histories Merging Network for Temporal Knowledge Graph Reasoning
    Liu, Shihao
    Zhou, Xiaofei
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XIII, ICIC 2024, 2024, 14874 : 158 - 169
  • [27] Multi-Granularity Graph Convolution Network for Major Depressive Disorder Recognition
    Sun, Xiaofang
    Xu, Yonghui
    Zhao, Yibowen
    Zheng, Xiangwei
    Cui, Lizhen
    Zheng, Yongqing
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 559 - 569
  • [28] Multi-granularity heterogeneous graph attention networks for extractive document summarization
    Zhao, Yu
    Wang, Leilei
    Wang, Cui
    Du, Huaming
    Wei, Shaopeng
    Feng, Huali
    Yu, Zongjian
    Li, Qing
    NEURAL NETWORKS, 2022, 155 : 340 - 347
  • [29] Fine-Grained Video Captioning via Graph-based Multi-Granularity Interaction Learning
    Yan, Yichao
    Zhuang, Ning
    Ni, Bingbing
    Zhang, Jian
    Xu, Minghao
    Zhang, Qiang
    Zheng, Zhang
    Cheng, Shuo
    Tian, Qi
    Xu, Yi
    Yang, Xiaokang
    Zhang, Wenjun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 666 - 683
  • [30] Multi-granularity Histories Merging Network for Temporal Knowledge Graph Reasoning
    Liu, Shihao
    Zhou, Xiaofei
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2024, 14874 LNCS : 158 - 169