Diffusion Model-Enhanced Contrastive Learning for Graph Representation

被引:0
|
作者
Dai, Qi [1 ]
Song, Yumeng [1 ]
Gu, Yu [1 ]
Li, Fangfang [1 ]
Li, Xiaohua [1 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang, Liaoning, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive Learning; Graph Representation Learning; Unsupervised Learning; Diffusion Model;
D O I
10.1007/978-981-97-5572-1_22
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised Graph Contrastive Learning (GCL) aims to derive graph representations for downstream tasks without labeled data. While GCL methods have made significant progress, they suffer from limitations including noise amplification and neglecting global structural and semantic information. In this paper, we propose Diffusion Model-Enhanced Graph Contrastive Learning (DiffGCL) to overcome these limitations and enhance graph representation learning for the first time. Specifically, a graph-specific diffusion module is designed to explicitly capture global structural and semantic patterns by controlled Gaussian noise injection and an attention-based graph denoising network. A GCL module focuses on capturing local discriminative information. Through integrating the diffusion model with GCL, a shared graph encoder can acquire both global and local structures and semantic information within the graph while efficiently removing noise, leading to significant performance enhancement. Experimental results on real-world datasets demonstrate the effectiveness of DiffGCL, showing that it outperforms state-of-the-art competitors in graph classification accuracy.
引用
收藏
页码:332 / 341
页数:10
相关论文
共 50 条
  • [21] Graph Representation Learning In A Contrastive Framework For Community Detection
    Balouchi, Mehdi
    Ahmadi, Ali
    2021 26TH INTERNATIONAL COMPUTER CONFERENCE, COMPUTER SOCIETY OF IRAN (CSICC), 2021,
  • [22] Neighborhood contrastive representation learning for attributed graph clustering
    Wang, Tong
    Wu, Junhua
    Qi, Yaolei
    Qi, Xiaoming
    Guan, Juwei
    Zhang, Yuan
    Yang, Guanyu
    NEUROCOMPUTING, 2023, 562
  • [23] DISENTANGLED GRAPH REPRESENTATION WITH CONTRASTIVE LEARNING FOR RUMOR DETECTION
    Liu, Haoyu
    Xue, Yuanhai
    Yu, Xiaoming
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6470 - 6474
  • [24] Graph Joint Representation Clustering via Penalized Graph Contrastive Learning
    Zhao, Zihua
    Wang, Rong
    Wang, Zheng
    Nie, Feiping
    Li, Xuelong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 17650 - 17661
  • [25] MDGCL: Graph Contrastive Learning Framework with Multiple Graph Diffusion Methods
    Li, Yuqiang
    Zhang, Yi
    Liu, Chun
    NEURAL PROCESSING LETTERS, 2024, 56 (04)
  • [26] Diffusion induced graph representation learning
    Li, Fuzhen
    Zhu, Zhenfeng
    Zhang, Xingxing
    Cheng, Jian
    Zhao, Yao
    NEUROCOMPUTING, 2019, 360 : 220 - 229
  • [27] Local structure-aware graph contrastive representation learning
    Yang, Kai
    Liu, Yuan
    Zhao, Zijuan
    Ding, Peijin
    Zhao, Wenqian
    NEURAL NETWORKS, 2024, 172
  • [28] Graph Enhanced Contrastive Learning for Radiology Findings Summarization
    Hu, Jinpeng
    Li, Zhuo
    Chen, Zhihong
    Li, Zhen
    Wan, Xiang
    Chang, Tsung-Hui
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 4677 - 4688
  • [29] Structure-Enhanced Heterogeneous Graph Contrastive Learning
    Zhu, Yanqiao
    Xu, Yichen
    Cui, Hejie
    Yang, Carl
    Liu, Qiang
    Wu, Shu
    PROCEEDINGS OF THE 2022 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2022, : 82 - 90
  • [30] Contrastive Multi-Modal Knowledge Graph Representation Learning
    Fang, Quan
    Zhang, Xiaowei
    Hu, Jun
    Wu, Xian
    Xu, Changsheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 8983 - 8996