GMNI: Achieve good data augmentation in unsupervised graph contrastive learning

被引:0
|
作者
Xiong, Xin [1 ]
Wang, Xiangyu [1 ]
Yang, Suorong [1 ]
Shen, Furao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph contrastive learning; Data augmentation;
D O I
10.1016/j.neunet.2024.106804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning (GCL) shows excellent potential in unsupervised graph representation learning. Data augmentation (DA), responsible for generating diverse views, plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. However, it is impossible to measure task-relevant information under an unsupervised setting. Therefore, many GCL methods risk insufficient information by failing to preserve essential information necessary for the downstream task or risk encoding redundant information. In this paper, we propose a novel method called Minimal Noteworthy Information for unsupervised Graph contrastive learning (GMNI), featuring automated DA. It achieves good DA by balancing missing and excessive information, approximating the optimal views in contrastive learning. We employ an adversarial training strategy to generate views that share minimal noteworthy information (MNI), reducing nuisance information by minimization optimization and ensuring sufficient information by emphasizing noteworthy information. Besides, we introduce randomness based on MNI to augmentation, thereby enhancing view diversity and stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning over 14 datasets demonstrate the superiority of GMNI over GCL methods with automated and manual DA. GMNI achieves up to a 1.64% improvement over the state-of-the-art in unsupervised node classification, up to a 1.97% improvement in unsupervised graph classification, and up to a 3.57% improvement in semi-supervised graph classification.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Neighbor Contrastive Learning on Learnable Graph Augmentation
    Shen, Xiao
    Sun, Dewang
    Pan, Shirui
    Zhou, Xi
    Yang, Laurence T.
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 9782 - 9791
  • [22] Video Representation Learning with Graph Contrastive Augmentation
    Zhang, Jingran
    Xu, Xing
    Shen, Fumin
    Yao, Yazhou
    Shao, Jie
    Zhu, Xiaofeng
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3043 - 3051
  • [23] Improving Augmentation Consistency for Graph Contrastive Learning
    Bu, Weixin
    Cao, Xiaofeng
    Zheng, Yizhen
    Pan, Shirui
    PATTERN RECOGNITION, 2024, 148
  • [24] Graph Contrastive Learning with Adaptive Augmentation for Recommendation
    Jing, Mengyuan
    Zhu, Yanmin
    Zang, Tianzi
    Yu, Jiadi
    Tang, Feilong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 590 - 605
  • [25] Unsupervised Structure-Adaptive Graph Contrastive Learning
    Zhao, Han
    Yang, Xu
    Deng, Cheng
    Tao, Dacheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13728 - 13740
  • [26] PAGCL: An unsupervised graph poisoned attack for graph contrastive learning model
    Li, Qing
    Wang, Ziyue
    Li, Zehao
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 149 : 240 - 249
  • [27] Unsupervised Graph Structure Learning Based on Optimal Graph Topology Modeling and Adaptive Data Augmentation
    An, Dongdong
    Pan, Zongxu
    Zhao, Qin
    Liu, Wenyan
    Liu, Jing
    MATHEMATICS, 2024, 12 (13)
  • [28] Graph Contrastive Learning With Feature Augmentation for Rumor Detection
    Li, Shaohua
    Li, Weimin
    Luvembe, Alex Munyole
    Tong, Weiqin
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04): : 5158 - 5167
  • [29] Mixed Augmentation Contrastive Learning for Graph Recommendation System
    Dong, Zhuolun
    Yang, Yan
    Zhong, Yingli
    WEB AND BIG DATA, APWEB-WAIM 2024, PT II, 2024, 14962 : 130 - 143
  • [30] Spectral Feature Augmentation for Graph Contrastive Learning and Beyond
    Zhang, Yifei
    Zhu, Hao
    Song, Zixing
    Koniusz, Piotr
    King, Irwin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 11289 - 11297