Fine-Grained Semantics Enhanced Contrastive Learning for Graphs

被引:0
|
作者
Liu, Youming [1 ]
Shu, Lin [1 ]
Chen, Chuan [1 ]
Zheng, Zibin [2 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[2] Sun Yat Sen Univ, Sch Software Engn, Zhuhai 519082, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Contrastive learning; Histograms; Accuracy; Training; Synthetic data; Fuses; semantic information; fine-grained; graph motifs; node classification; ROUGH SETS; OVERLAP FUNCTIONS; SELECTION; (I;
D O I
10.1109/TKDE.2024.3466990
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past few years. Nevertheless, existing methods of graph contrastive learning ignore the differences between diverse semantics existed in graphs, which learn coarse-grained node embeddings and lead to sub-optimal performances on downstream tasks. To bridge this gap, we propose a novel Fine-grained Semantics enhanced Graph Contrastive Learning (FSGCL) in this paper. Concretely, FSGCL first introduces a motif-based graph construction, which employs graph motifs to extract diverse semantics existed in graphs from the perspective of input data. Then, the semantic-level contrastive task is explored to further enhance the utilization of fine-grained semantics from the perspective of model training. Experiments on five real-world datasets demonstrate the superiority of our proposed FSGCL over state-of-the-art methods. To make the results reproducible, we will make our codes public on GitHub after this paper is accepted.
引用
收藏
页码:8238 / 8250
页数:13
相关论文
共 50 条
  • [1] GRAPH FINE-GRAINED CONTRASTIVE REPRESENTATION LEARNING
    Tang, Hui
    Liang, Xun
    Guo, Yuhui
    Zheng, Xiangping
    Wu, Bo
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3478 - 3482
  • [2] Fine-grained Angular Contrastive Learning with Coarse Labels
    Bukchin, Guy
    Schwartz, Eli
    Saenko, Kate
    Shahar, Ori
    Feris, Rogerio
    Giryes, Raja
    Karlinsky, Leonid
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8726 - 8736
  • [3] Fine-Grained Contrastive Learning for Pulmonary Nodule Classification
    Zheng, Yubin
    Tang, Peng
    Ju, Tianjie
    Qiu, Weidong
    Yan, Bo
    Proceedings of the International Joint Conference on Neural Networks, 2024,
  • [4] Fine-grained and coarse-grained contrastive learning for text classification
    Zhang, Shaokang
    Ran, Ning
    NEUROCOMPUTING, 2024, 596
  • [5] PARTICLE: Part Discovery and Contrastive Learning for Fine-grained Recognition
    Saha, Oindrila
    Maji, Subhransu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 167 - 176
  • [6] Fine-grained adaptive contrastive learning for unsupervised feature extraction
    Yin, Tianyi
    Wang, Jingwei
    Zhao, Yukai
    Wang, Han
    Ma, Yunlong
    Liu, Min
    NEUROCOMPUTING, 2025, 618
  • [7] Estimating Fine-Grained Noise Model via Contrastive Learning
    Zou, Yunhao
    Fu, Ying
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12672 - 12681
  • [8] Contrastive Representations for Continual Learning of Fine-Grained Histology Images
    Chakraborti, Tapabrata
    Gleeson, Fergus
    Rittscher, Jens
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 1 - 9
  • [9] Angelic semantics of fine-grained concurrency
    Ghica, DR
    Murawski, AS
    FOUNDATIONS OF SOFTWARE SCIENCE AND COMPUTATION STRUCTURES, PROCEEDINGS, 2004, 2987 : 211 - 225
  • [10] Fine-grained semantics for attitude reports
    Lederman, Harvey
    SEMANTICS & PRAGMATICS, 2021, 14