FGTL: Federated Graph Transfer Learning for Node Classification

被引:0
|
作者
Mai, Chengyuan [1 ]
Liao, Tianchi [1 ]
Chen, Chuan [1 ]
Zheng, Zibin [2 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Sun Yat Sen Univ, Zhuhai, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Federated learning; Graph neural network; Transfer learning; Contrastive learning; Consensus knowledge;
D O I
10.1145/3699962
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised multi-source domain transfer in federated scenario has become an emerging research direction, which can help unlabeled target domain to obtain the adapted model through source domains under privacy preserving. However, when local data are graph, the difference of domains (or data heterogeneity) mainly originates from the difference in node attributes and sub-graph structures, leading to serious model drift, which is not considered by the existing related algorithms. Currently, there are two challenges in this scenario: (1) The node representations extracted directly through conventional GNNs lack inter-domain generalized and consistent information, making it difficult to apply existing federated learning algorithms. (2) The knowledge of source domains has quality differences, which may lead to negative transfer. To address these issues, we propose a novel two-phase Federated Graph Transfer Learning (FGTL) framework. In the generalization phase, FGTL utilizes local contrastive learning and global context embedding to force node representations to capture the inter-domain generalized and consistent information, lightly alleviating model drift. In the transfer phase, FGTL utilizes consensus knowledge to force the decision bound of classifier to adapt to the target client. In addition, FGTL+ exploits model grouping to make consensus knowledge generation more efficient, further enhancing the scalability of FGTL. Extensive experiments show that FGTL significantly outperforms state-of-the-art related methods, while FGTL+ further enhances privacy protection and reduces both communication and computation overhead.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Graph Federated Learning with Center Moment Constraints for Node Classification
    Tang, Bisheng
    Chen, Xiaojun
    Wang, Shaopu
    Xuan, Yuexin
    Zhao, Zhendong
    53RD INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2024, 2024, : 86 - 95
  • [2] Federated Graph Augmentation for Semisupervised Node Classification
    Xia, Zhichang
    Zhang, Xinglin
    Liang, Lingyu
    Li, Yun
    Gong, Yuejiao
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (03): : 3232 - 3242
  • [3] SemiGraphFL: Semi-supervised Graph Federated Learning for Graph Classification
    Tao, Ye
    Li, Ying
    Wu, Zhonghai
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVII, PPSN 2022, PT I, 2022, 13398 : 474 - 487
  • [4] Federated Transfer Learning for EEG Signal Classification
    Ju, Ce
    Gao, Dashan
    Mane, Ravikiran
    Tan, Ben
    Liu, Yang
    Guan, Cuntai
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 3040 - 3045
  • [5] Property graph representation learning for node classification
    Shu Li
    Nayyar A. Zaidi
    Meijie Du
    Zhou Zhou
    Hongfei Zhang
    Gang Li
    Knowledge and Information Systems, 2024, 66 (1) : 237 - 265
  • [6] Property graph representation learning for node classification
    Li, Shu
    Zaidi, Nayyar A.
    Du, Meijie
    Zhou, Zhou
    Zhang, Hongfei
    Li, Gang
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (01) : 237 - 265
  • [7] Line graph contrastive learning for node classification
    Li, Mingyuan
    Meng, Lei
    Ye, Zhonglin
    Xiao, Yuzhi
    Cao, Shujuan
    Zhao, Haixing
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (04)
  • [8] Automated Graph Representation Learning for Node Classification
    Sun, Junwei
    Wang, Bai
    Wu, Bin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] PUMA: Efficient Continual Graph Learning for Node Classification With Graph Condensation
    Liu, Yilun
    Qiu, Ruihong
    Tang, Yanran
    Yin, Hongzhi
    Huang, Zi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (01) : 449 - 461
  • [10] Graph alternate learning for robust graph neural networks in node classification
    Zhang, Baoliang
    Guo, Xiaoxin
    Tu, Zhenchuan
    Zhang, Jia
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (11): : 8723 - 8735