GMNI: Achieve good data augmentation in unsupervised graph contrastive learning

被引:0
|
作者
Xiong, Xin [1 ]
Wang, Xiangyu [1 ]
Yang, Suorong [1 ]
Shen, Furao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph neural network; Graph contrastive learning; Data augmentation;
D O I
10.1016/j.neunet.2024.106804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph contrastive learning (GCL) shows excellent potential in unsupervised graph representation learning. Data augmentation (DA), responsible for generating diverse views, plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. However, it is impossible to measure task-relevant information under an unsupervised setting. Therefore, many GCL methods risk insufficient information by failing to preserve essential information necessary for the downstream task or risk encoding redundant information. In this paper, we propose a novel method called Minimal Noteworthy Information for unsupervised Graph contrastive learning (GMNI), featuring automated DA. It achieves good DA by balancing missing and excessive information, approximating the optimal views in contrastive learning. We employ an adversarial training strategy to generate views that share minimal noteworthy information (MNI), reducing nuisance information by minimization optimization and ensuring sufficient information by emphasizing noteworthy information. Besides, we introduce randomness based on MNI to augmentation, thereby enhancing view diversity and stabilizing the model against perturbations. Extensive experiments on unsupervised and semi-supervised learning over 14 datasets demonstrate the superiority of GMNI over GCL methods with automated and manual DA. GMNI achieves up to a 1.64% improvement over the state-of-the-art in unsupervised node classification, up to a 1.97% improvement in unsupervised graph classification, and up to a 3.57% improvement in semi-supervised graph classification.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Graph contrastive learning networks with augmentation for legal judgment prediction
    Dong, Yao
    Li, Xinran
    Shi, Jin
    Dong, Yongfeng
    Chen, Chen
    ARTIFICIAL INTELLIGENCE AND LAW, 2024,
  • [42] Dual-view data augmentation at subgraph level and graph contrastive learning for sequential recommendation
    Mu, Caihong
    Yu, Haikun
    Qin, Lang
    Liu, Yi
    MACHINE LEARNING, 2025, 114 (03)
  • [43] Representing Spatial Data with Graph Contrastive Learning
    Fang, Lanting
    Kou, Ze
    Yang, Yulian
    Li, Tao
    REMOTE SENSING, 2023, 15 (04)
  • [44] Attraction and Repulsion: Unsupervised Domain Adaptive Graph Contrastive Learning Network
    Wu, Man
    Pan, Shirui
    Zhu, Xingquan
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (05): : 1079 - 1091
  • [45] Unsupervised learning using topological data augmentation
    Balabanov, Oleksandr
    Granath, Mats
    PHYSICAL REVIEW RESEARCH, 2020, 2 (01):
  • [46] Unsupervised Multiview Graph Contrastive Feature Learning for Hyperspectral Image Classification
    Chang, Yuan
    Liu, Quanwei
    Zhang, Yuxiang
    Dong, Yanni
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [47] Data Augmentation, Internal Representation, and Unsupervised Learning
    Wu, Ying Nian
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2011, 20 (03) : 581 - 583
  • [48] Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning
    Ding, Kaize
    Wang, Yancheng
    Yang, Yingzhen
    Liu, Huan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 7378 - 7386
  • [49] Semisupervised Machine Fault Diagnosis Fusing Unsupervised Graph Contrastive Learning
    Yang, Chaoying
    Liu, Jie
    Zhou, Kaibo
    Jiang, Xingxing
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (08) : 8644 - 8653
  • [50] A Unique Framework of Heterogeneous Augmentation Graph Contrastive Learning for Both Node and Graph Classification
    Shao, Qi
    Chen, Duxin
    Yu, Wenwu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5818 - 5828