Diffusion Model-Enhanced Contrastive Learning for Graph Representation

被引:0
|
作者
Dai, Qi [1 ]
Song, Yumeng [1 ]
Gu, Yu [1 ]
Li, Fangfang [1 ]
Li, Xiaohua [1 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive Learning; Graph Representation Learning; Unsupervised Learning; Diffusion Model;
D O I
10.1007/978-981-97-5572-1_22
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised Graph Contrastive Learning (GCL) aims to derive graph representations for downstream tasks without labeled data. While GCL methods have made significant progress, they suffer from limitations including noise amplification and neglecting global structural and semantic information. In this paper, we propose Diffusion Model-Enhanced Graph Contrastive Learning (DiffGCL) to overcome these limitations and enhance graph representation learning for the first time. Specifically, a graph-specific diffusion module is designed to explicitly capture global structural and semantic patterns by controlled Gaussian noise injection and an attention-based graph denoising network. A GCL module focuses on capturing local discriminative information. Through integrating the diffusion model with GCL, a shared graph encoder can acquire both global and local structures and semantic information within the graph while efficiently removing noise, leading to significant performance enhancement. Experimental results on real-world datasets demonstrate the effectiveness of DiffGCL, showing that it outperforms state-of-the-art competitors in graph classification accuracy.
引用
收藏
页码:332 / 341
页数:10
相关论文
共 50 条
  • [41] Multi-view graph contrastive representation learning for bundle recommendation
    Zhang, Peng
    Niu, Zhendong
    Ma, Ru
    Zhang, Fuzhi
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (01)
  • [42] Graph Representation Learning-Guided Diffusion Model for Hyperspectral Change Detection
    Ding, Xinyu
    Qu, Jiahui
    Dong, Wenqian
    Zhang, Tongzhen
    Li, Nan
    Yang, Yufei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [43] Temporal knowledge graph reasoning based on evolutional representation and contrastive learning
    Ma, Qiuying
    Zhang, Xuan
    Ding, Zishuo
    Gao, Chen
    Shang, Weiyi
    Nong, Qiong
    Ma, Yubin
    Jin, Zhi
    APPLIED INTELLIGENCE, 2024, 54 (21) : 10929 - 10947
  • [44] Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methods
    Cao, Yuji
    Zhao, Huan
    Cheng, Yuheng
    Shu, Ting
    Chen, Yue
    Liu, Guolong
    Liang, Gaoqi
    Zhao, Junhua
    Yan, Jinyue
    Li, Yun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [45] Social Relation Enhanced Heterogeneous Graph Contrastive Learning for Recommendation
    Wang, Jiaxi
    Wang, Bingce
    Zhang, Liwen
    Mo, Tong
    Li, Weiping
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT VI, DASFAA 2024, 2024, 14855 : 19 - 34
  • [46] Graph Embedding Contrastive Multi-Modal Representation Learning for Clustering
    Xia, Wei
    Wang, Tianxiu
    Gao, Quanxue
    Yang, Ming
    Gao, Xinbo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1170 - 1183
  • [47] CSGCL: Community-Strength-Enhanced Graph Contrastive Learning
    Chen, Han
    Zhao, Ziwen
    Li, Yuhua
    Zou, Yixiong
    Li, Ruixuan
    Zhang, Rui
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2059 - 2067
  • [48] Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network
    Liu N.
    Wang X.
    Han H.
    Shi C.
    IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10) : 10884 - 10896
  • [49] Community-Enhanced Contrastive Learning for Graph Collaborative Filtering
    Xia, Xuchen
    Ma, Wenming
    Zhang, Jinkai
    Zhang, En
    ELECTRONICS, 2023, 12 (23)
  • [50] Hierarchical Graph Contrastive Learning for Review-Enhanced Recommendation
    Shui, Changsheng
    Li, Xiang
    Qi, Jianpeng
    Jiang, Guiyuan
    Yu, Yanwei
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES-RESEARCH TRACK, PT VI, ECML PKDD 2024, 2024, 14946 : 423 - 440