New Learning Models Based on the Combination of Variational Graph Autoencoder/Graph Autoencoder with Context Self-supervised Learning for Link Prediction

被引:0
|
作者
Zhang, Jian [1 ]
Gao, Yun Hai [2 ]
Zhang, Gui Yun [2 ]
机构
[1] Nankai Univ, Tianjin, Peoples R China
[2] Tianjin Normal Univ, Tianjin, Peoples R China
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024 | 2024年 / 14875卷
关键词
Graph Neural Networks; Auto-Encoder; Contextual Information; Link Prediction;
D O I
10.1007/978-981-97-5663-6_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study introduces two novel graph data representation learning models: Context Self-Supervised Learning Graph Auto-Encoders (CSSL-GAE) and Context Self-Supervised Learning Variational Graph Auto-Encoders (CSSLV-GAE). These models integrate graph auto-encoders (GAE), variational graph auto-encoders (VGAE), and context self-supervised learning (CSSL) to elevate the performance of link prediction tasks. Initially, we clarify the intricacies of link prediction challenges and their relevance in graph data. Following this, we offer a comprehensive introduction to the GAE and VGAE models, emphasizing their excellence in representing latent variables when learning graph structures. We then introduce CSSL, which enriches node representations by acquiring contextual information from nodes. The integration of these two models, CSSL-GAE and CSSL-VGAE, showcases remarkable performance in link prediction tasks, exhibiting stronger expressive and generalization abilities. Experimental results conducted on classic datasets, including Cora, Citeseer, and Pubmed, reveal significant performance improvements in comparison to models solely relying on GAE, VGAE, or CSSL. Ultimately, we summarize the potential influence of these models in the realm of graph data representation learning, paving the way for future research directions.
引用
收藏
页码:245 / 256
页数:12
相关论文
共 50 条
  • [21] DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations
    Dai, Jiuqian
    Yuan, Weihua
    Bao, Chen
    Zhang, Zhijun
    APPLIED INTELLIGENCE, 2023, 53 (14) : 17292 - 17309
  • [22] DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations
    Jiuqian Dai
    Weihua Yuan
    Chen Bao
    Zhijun Zhang
    Applied Intelligence, 2023, 53 : 17292 - 17309
  • [23] Mixed Autoencoder for Self-supervised Visual Representation Learning
    Chen, Kai
    Liu, Zhili
    Hong, Lanqing
    Xu, Hang
    Li, Zhenguo
    Yeung, Dit-Yan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22742 - 22751
  • [24] Self-supervised Discriminative Representation Learning by Fuzzy Autoencoder
    Yang, Wenlu
    Wang, Hongjun
    Zhang, Yinghui
    Liu, Zehao
    Li, Tianrui
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (01)
  • [25] A Survey on Masked Autoencoder for Visual Self-supervised Learning
    Zhang, Chaoning
    Zhang, Chenshuang
    Song, Junha
    Yi, John Seon Keun
    Kweon, In So
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 6805 - 6813
  • [26] Self-supervised Variational Autoencoder for Recommender Systems
    Wang, Jing
    Liu, Gangdu
    Wu, Jun
    Jia, Caiyan
    Zhang, Zhifei
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 831 - 835
  • [27] Deep Self-Supervised Graph Attention Convolution Autoencoder for Networks Clustering
    Chen, Chao
    Lu, Hu
    Hong, Haotian
    Wang, Hai
    Wan, Shaohua
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2023, 69 (04) : 974 - 983
  • [28] Self-supervised Graph Learning with Segmented Graph Channels
    Gao, Hang
    Li, Jiangmeng
    Zheng, Changwen
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II, 2023, 13714 : 293 - 308
  • [29] Self-supervised Graph Learning for Recommendation
    Wu, Jiancan
    Wang, Xiang
    Feng, Fuli
    He, Xiangnan
    Chen, Liang
    Lian, Jianxun
    Xie, Xing
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 726 - 735
  • [30] Graph Adversarial Self-Supervised Learning
    Yang, Longqi
    Zhang, Liangliang
    Yang, Wenjing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34