New Learning Models Based on the Combination of Variational Graph Autoencoder/Graph Autoencoder with Context Self-supervised Learning for Link Prediction

被引:0
|
作者
Zhang, Jian [1 ]
Gao, Yun Hai [2 ]
Zhang, Gui Yun [2 ]
机构
[1] Nankai Univ, Tianjin, Peoples R China
[2] Tianjin Normal Univ, Tianjin, Peoples R China
关键词
Graph Neural Networks; Auto-Encoder; Contextual Information; Link Prediction;
D O I
10.1007/978-981-97-5663-6_21
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study introduces two novel graph data representation learning models: Context Self-Supervised Learning Graph Auto-Encoders (CSSL-GAE) and Context Self-Supervised Learning Variational Graph Auto-Encoders (CSSLV-GAE). These models integrate graph auto-encoders (GAE), variational graph auto-encoders (VGAE), and context self-supervised learning (CSSL) to elevate the performance of link prediction tasks. Initially, we clarify the intricacies of link prediction challenges and their relevance in graph data. Following this, we offer a comprehensive introduction to the GAE and VGAE models, emphasizing their excellence in representing latent variables when learning graph structures. We then introduce CSSL, which enriches node representations by acquiring contextual information from nodes. The integration of these two models, CSSL-GAE and CSSL-VGAE, showcases remarkable performance in link prediction tasks, exhibiting stronger expressive and generalization abilities. Experimental results conducted on classic datasets, including Cora, Citeseer, and Pubmed, reveal significant performance improvements in comparison to models solely relying on GAE, VGAE, or CSSL. Ultimately, we summarize the potential influence of these models in the realm of graph data representation learning, paving the way for future research directions.
引用
收藏
页码:245 / 256
页数:12
相关论文
共 50 条
  • [1] Context Autoencoder for Self-supervised Representation Learning
    Xiaokang Chen
    Mingyu Ding
    Xiaodi Wang
    Ying Xin
    Shentong Mo
    Yunhao Wang
    Shumin Han
    Ping Luo
    Gang Zeng
    Jingdong Wang
    International Journal of Computer Vision, 2024, 132 : 208 - 223
  • [2] GMAEEG: A Self-Supervised Graph Masked Autoencoder for EEG Representation Learning
    Fu, Zanhao
    Zhu, Huaiyu
    Zhao, Yisheng
    Huan, Ruohong
    Zhang, Yi
    Chen, Shuohui
    Pan, Yun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (11) : 6486 - 6497
  • [3] GMAEEG: A Self-Supervised Graph Masked Autoencoder for EEG Representation Learning
    Fu, Zanhao
    Zhu, Huaiyu
    Zhao, Yisheng
    Huan, Ruohong
    Zhang, Yi
    Chen, Shuohui
    Pan, Yun
    IEEE Journal of Biomedical and Health Informatics, 2024, 28 (11): : 6486 - 6497
  • [4] Context Autoencoder for Self-supervised Representation Learning
    Chen, Xiaokang
    Ding, Mingyu
    Wang, Xiaodi
    Xin, Ying
    Mo, Shentong
    Wang, Yunhao
    Han, Shumin
    Luo, Ping
    Zeng, Gang
    Wang, Jingdong
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 132 (1) : 208 - 223
  • [5] Dual stream fusion link prediction for sparse graph based on variational graph autoencoder and pairwise learning
    Li, Xun
    Cai, Hongyun
    Feng, Chuan
    Zhao, Ao
    INFORMATION PROCESSING & MANAGEMENT, 2025, 62 (03)
  • [6] Dual stream fusion link prediction for sparse graph based on variational graph autoencoder and pairwise learning
    Li, Xun
    Cai, Hongyun
    Feng, Chuan
    Zhao, Ao
    Information Processing and Management, 62 (03):
  • [7] A Self-supervised Graph Autoencoder with Barlow Twins
    Li, Jingci
    Lu, Guangquan
    Li, Jiecheng
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT II, 2022, 13630 : 501 - 512
  • [8] Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection
    Zhang, Le
    Cheng, Wei
    Xing, Ji
    Chen, Xuefeng
    Nie, Zelin
    Zhang, Shuo
    Hong, Junying
    Xu, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [9] Self-supervised reconstructed graph learning for link prediction in bipartite graphs
    Jin, Xu
    Kong, Desheng
    Xie, Maoqiang
    Huang, Yalou
    Liu, Mingming
    Yang, Weiwei
    Shi, Hao
    Liu, Yue
    NEUROCOMPUTING, 2024, 602
  • [10] Self-supervised variational autoencoder towards recommendation by nested contrastive learning
    Jing Wang
    Jun Wu
    Caiyan Jia
    Zhifei Zhang
    Applied Intelligence, 2023, 53 : 18887 - 18897