Multi-Granularity Federated Learning by Graph-Partitioning

被引:0
|
作者
Dai, Ziming [1 ,2 ]
Zhao, Yunfeng [1 ]
Qiu, Chao [1 ,2 ]
Wang, Xiaofei [1 ,2 ]
Yao, Haipeng [3 ]
Niyato, Dusit [4 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300072, Peoples R China
[2] Guangdong Lab Artificial Intelligence & Digital Ec, Shenzhen 518000, Peoples R China
[3] Beijing Univ Posts & Telecommun, Informat & Commun Engn, Beijing 100876, Peoples R China
[4] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Blockchain-based federated learning; consortium blockchain; balanced graph partitioning; cross-granularity guid- ance; credit model; RESOURCE-ALLOCATION; INTELLIGENCE;
D O I
10.1109/TCC.2024.3494765
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In edge computing, energy-limited distributed edge clients present challenges such as heterogeneity, high energy consumption, and security risks. Traditional blockchain-based federated learning (BFL) struggles to address all three of these challenges simultaneously. This article proposes a Graph-Partitioning Multi-Granularity Federated Learning method on a consortium blockchain, namely GP-MGFL. To reduce the overall communication overhead, we adopt a balanced graph partitioning algorithm while introducing observer and consensus nodes. This method groups clients to minimize high-cost communications and focuses on the guidance effect within each group, thereby ensuring effective guidance with reduced overhead. To fully leverage heterogeneity, we introduce a cross-granularity guidance mechanism. This mechanism involves fine-granularity models guiding coarse-granularity models to enhance the accuracy of the latter models. We also introduce a credit model to adjust the contribution of models to the global model dynamically and to dynamically select leaders responsible for model aggregation. Finally, we implement a prototype system on real physical hardware and compare it with several baselines. Experimental results show that the accuracy of the GP-MGFL algorithm is 5.6% higher than that of ordinary BFL algorithms. In addition, compared to other grouping methods, such as greedy grouping, the accuracy of the proposed method improves by about 1.5%. In scenarios with malicious clients, the maximum accuracy improvement reaches 11.1%. We also analyze and summarize the impact of grouping and the number of clients on the model, as well as the impact of this method on the inherent security of the blockchain itself.
引用
收藏
页码:18 / 33
页数:16
相关论文
共 50 条
  • [41] Disconnector Fault Diagnosis Based on Multi-Granularity Contrast Learning
    Xie, Qian
    Tang, Haiyi
    Liu, Baize
    Li, Hui
    Wang, Zhe
    Dang, Jian
    PROCESSES, 2023, 11 (10)
  • [42] Multi-granularity contrastive learning model for next POI recommendation
    Zhu, Yunfeng
    Yao, Shuchun
    Sun, Xun
    FRONTIERS IN NEUROROBOTICS, 2024, 18
  • [43] DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
    Ma, Lei
    Juefei-Xu, Felix
    Zhang, Fuyuan
    Sun, Jiyuan
    Xue, Minhui
    Li, Bo
    Chen, Chunyang
    Su, Ting
    Li, Li
    Liu, Yang
    Zhao, Jianjun
    Wang, Yadong
    PROCEEDINGS OF THE 2018 33RD IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMTED SOFTWARE ENGINEERING (ASE' 18), 2018, : 120 - 131
  • [44] Multi-Granularity Representations of Dialog
    Mehri, Shikib
    Eskenazi, Maxine
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 1752 - 1761
  • [45] A multi-granularity genetic algorithm
    Li, Caoxiao
    Xia, Shuyin
    Chen, Zizhong
    Wang, Guoyin
    2019 10TH IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (ICBK 2019), 2019, : 135 - 141
  • [46] GAITMM: MULTI-GRANULARITY MOTION SEQUENCE LEARNING FOR GAIT RECOGNITION
    Wang, Lei
    Liu, Bo
    Wang, Bincheng
    Yu, Fuqiang
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 845 - 849
  • [47] Knowledge Transfer between Multi-granularity Models for Reinforcement Learning
    Wang, Lan
    Tang, Kaiqiang
    Xin, Bo
    Chen, Chunlin
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 2881 - 2886
  • [48] GNN-MgrPool: Enhanced graph neural networks with multi-granularity pooling for graph classification
    Sun, Haichao
    Wang, Guoyin
    Liu, Qun
    Guo, Yike
    INFORMATION SCIENCES, 2024, 680
  • [49] A Multi-granularity Contrastive Learning for Distantly Supervised Relation Extraction
    Jian, Zhaorui
    Liu, Shenquan
    Yin, Huixin
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024, 2024, 14875 : 352 - 364
  • [50] MCL: Multi-Granularity Contrastive Learning Framework for Chinese NER
    Zhao, Shan
    Wang, ChengYu
    Hu, Minghao
    Yan, Tianwei
    Wang, Meng
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 14011 - 14019