Diffusion Model-Enhanced Contrastive Learning for Graph Representation

被引:0
|
作者
Dai, Qi [1 ]
Song, Yumeng [1 ]
Gu, Yu [1 ]
Li, Fangfang [1 ]
Li, Xiaohua [1 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive Learning; Graph Representation Learning; Unsupervised Learning; Diffusion Model;
D O I
10.1007/978-981-97-5572-1_22
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised Graph Contrastive Learning (GCL) aims to derive graph representations for downstream tasks without labeled data. While GCL methods have made significant progress, they suffer from limitations including noise amplification and neglecting global structural and semantic information. In this paper, we propose Diffusion Model-Enhanced Graph Contrastive Learning (DiffGCL) to overcome these limitations and enhance graph representation learning for the first time. Specifically, a graph-specific diffusion module is designed to explicitly capture global structural and semantic patterns by controlled Gaussian noise injection and an attention-based graph denoising network. A GCL module focuses on capturing local discriminative information. Through integrating the diffusion model with GCL, a shared graph encoder can acquire both global and local structures and semantic information within the graph while efficiently removing noise, leading to significant performance enhancement. Experimental results on real-world datasets demonstrate the effectiveness of DiffGCL, showing that it outperforms state-of-the-art competitors in graph classification accuracy.
引用
收藏
页码:332 / 341
页数:10
相关论文
共 50 条
  • [31] A Topology-Enhanced Multi-Viewed Contrastive Approach for Molecular Graph Representation Learning and Classification
    Pham, Phu
    MOLECULAR INFORMATICS, 2025, 44 (01)
  • [32] Model-enhanced Vector Index
    Zhang, Hailin
    Wang, Yujing
    Chen, Qi
    Chang, Ruiheng
    Zhang, Ting
    Miao, Ziming
    Hou, Yingyan
    Ding, Yang
    Miao, Xupeng
    Wang, Haonan
    Pang, Bochen
    Zhan, Yuefeng
    Sun, Hao
    Deng, Weiwei
    Zhang, Qi
    Yang, Fan
    Xie, Xing
    Yang, Mao
    Cui, Bin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [33] Knowledge graph completion method based on hyperbolic representation learning and contrastive learning
    Zhang, Xiaodong
    Wang, Meng
    Zhong, Xiuwen
    An, Feixu
    EGYPTIAN INFORMATICS JOURNAL, 2023, 24 (04)
  • [34] Type-Enhanced Temporal Knowledge Graph Representation Learning Model
    He P.
    Zhou G.
    Chen J.
    Zhang M.
    Ning Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (04): : 916 - 929
  • [35] Towards Adaptable Graph Representation Learning: An Adaptive Multi-Graph Contrastive Transformer
    Li, Yan
    Zhang, Liang
    Lan, Xiangyuan
    Jiang, Dongmei
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6063 - 6071
  • [36] Directional diffusion models for graph representation learning
    Yang, Run
    Yang, Yuling
    Zhou, Fan
    Sun, Qiang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] Cross-scale contrastive triplet networks for graph representation learning☆
    Liu, Yanbei
    Shan, Wanjin
    Wang, Xiao
    Xiao, Zhitao
    Geng, Lei
    Zhang, Fang
    Du, Dongdong
    Pang, Yanwei
    PATTERN RECOGNITION, 2024, 145
  • [38] Towards Alignment-Uniformity Aware Representation in Graph Contrastive Learning
    Yan, Rong
    Bao, Peng
    Zhang, Xiao
    Liu, Zhongyi
    Liu, Hui
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, WSDM 2024, 2024, : 873 - 881
  • [39] Multi-View Graph Contrastive Learning for Urban Region Representation
    Zhang, Yu
    Xu, Yonghui
    Cui, Lizhen
    Yan, Zhongmin
    Proceedings of the International Joint Conference on Neural Networks, 2023, 2023-June
  • [40] Multi-View Graph Contrastive Learning for Urban Region Representation
    Zhang, Yu
    Xu, Yonghui
    Cui, Lizhen
    Yan, Zhongmin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,