Diffusion Model-Enhanced Contrastive Learning for Graph Representation

被引:0
|
作者
Dai, Qi [1 ]
Song, Yumeng [1 ]
Gu, Yu [1 ]
Li, Fangfang [1 ]
Li, Xiaohua [1 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive Learning; Graph Representation Learning; Unsupervised Learning; Diffusion Model;
D O I
10.1007/978-981-97-5572-1_22
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised Graph Contrastive Learning (GCL) aims to derive graph representations for downstream tasks without labeled data. While GCL methods have made significant progress, they suffer from limitations including noise amplification and neglecting global structural and semantic information. In this paper, we propose Diffusion Model-Enhanced Graph Contrastive Learning (DiffGCL) to overcome these limitations and enhance graph representation learning for the first time. Specifically, a graph-specific diffusion module is designed to explicitly capture global structural and semantic patterns by controlled Gaussian noise injection and an attention-based graph denoising network. A GCL module focuses on capturing local discriminative information. Through integrating the diffusion model with GCL, a shared graph encoder can acquire both global and local structures and semantic information within the graph while efficiently removing noise, leading to significant performance enhancement. Experimental results on real-world datasets demonstrate the effectiveness of DiffGCL, showing that it outperforms state-of-the-art competitors in graph classification accuracy.
引用
收藏
页码:332 / 341
页数:10
相关论文
共 50 条
  • [1] Clustering Enhanced Multiplex Graph Contrastive Representation Learning
    Yuan, Ruiwen
    Tang, Yongqiang
    Wu, Yajing
    Zhang, Wensheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) : 1341 - 1355
  • [2] Community-Enhanced Contrastive Siamese Networks for Graph Representation Learning
    Li, Yafang
    Wang, Wenbo
    Ma, Guixiang
    Zu, Baokai
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, KSEM 2023, 2023, 14117 : 300 - 314
  • [3] AGCL: Adaptive Graph Contrastive Learning for graph representation learning
    Yu, Jiajun
    Jia, Adele Lu
    NEUROCOMPUTING, 2024, 566
  • [4] Supervised contrastive learning for graph representation enhancement
    Ghayekhloo, Mohadeseh
    Nickabadi, Ahmad
    NEUROCOMPUTING, 2024, 588
  • [5] Graph Contrastive Learning with Positional Representation for Recommendation
    Yi, Zixuan
    Ounis, Iadh
    Macdonald, Craig
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2023, PT II, 2023, 13981 : 288 - 303
  • [6] Video Representation Learning with Graph Contrastive Augmentation
    Zhang, Jingran
    Xu, Xing
    Shen, Fumin
    Yao, Yazhou
    Shao, Jie
    Zhu, Xiaofeng
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3043 - 3051
  • [7] CuCo: Graph Representation with Curriculum Contrastive Learning
    Chu, Guanyi
    Wang, Xiao
    Shi, Chuan
    Jiang, Xunqiang
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 2300 - 2306
  • [8] Contrastive learning enhanced by graph neural networks for Universal Multivariate Time Series Representation
    Wang, Xinghao
    Xing, Qiang
    Xiao, Huimin
    Ye, Ming
    INFORMATION SYSTEMS, 2024, 125
  • [9] Contrastive learning enhanced by graph neural networks for Universal Multivariate Time Series Representation
    College of Artificial Intelligence, Southwest University, Chongqing
    400715, China
    Inf. Syst.,
  • [10] Learning Robust Representation Through Graph Adversarial Contrastive Learning
    Guo, Jiayan
    Li, Shangyang
    Zhao, Yue
    Zhang, Yan
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2022, 13245 LNCS : 682 - 697