Class-homophilic-based data augmentation for improving graph neural networks

被引:3
|
作者
Duan, Rui [1 ]
Yan, Chungang
Wang, Junli
Jiang, Changjun [2 ]
机构
[1] Tongji Univ, Natl Prov Minist Joint Collaborat Innovat Ctr Fin, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai 201804, Peoples R China
关键词
Graph neural networks; Graph data augmentation; Approximate class-homophilic graph; Self-attention mechanisms; REPRESENTATION; DESIGN;
D O I
10.1016/j.knosys.2023.110518
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data augmentation has been shown to improve graph neural networks (GNNs). Existing graph data augmentation is achieved by adding or removing edges or changing the input node features due to graph data's complexity and non-Euclidean nature. However, the graphs generated by the above augmentation operations have similar or identical structures as the original graph, which leads to similar or identical structural information learned by GNNs from the original and augmented graphs. Two problems arise from this: restricted information and low applicability. To solve these problems, we propose Class-hOmophilic-based Data Augmentation (CODA), which improves existing GNNs by helping them learn adequate and extra structural class information, which is lacking in the original graph, and promotes GNNs' application to graphs with a large number of interclass edges. We first pretrain the GNNs and then design a new augmentation method that generates an approximate class-homophilic graph according to the pretrained GNNs. In the end, we design learnable node-level self-attention mechanisms with telescopic coefficients, which result in GNNs integrating the structural information of the two graphs in a more principled way to break the constraint of pretrained GNNs. Extensive experiments on various datasets show that augmentation via CODA improves performance and applicability across GNN architectures. The source code of CODA is publicly available at https: //github.com/graphNN/CODA.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Data Augmentation for Graph Neural Networks
    Zhao, Tong
    Liu, Yozen
    Neves, Leonardo
    Woodford, Oliver
    Jiang, Meng
    Shah, Neil
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11015 - 11023
  • [2] Rationalizing Graph Neural Networks with Data Augmentation
    Liu, Gang
    Inae, Eric
    Luo, Tengfei
    Jiang, Meng
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (04)
  • [3] Improving Distinguishability of Class for Graph Neural Networks
    He, Dongxiao
    Liu, Shuwei
    Ge, Meng
    Yu, Zhizhi
    Xu, Guangquan
    Feng, Zhiyong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 12349 - 12357
  • [4] Backdoor Attacks on Graph Neural Networks Trained with Data Augmentation
    Yashiki, Shingo
    Takahashi, Chako
    Suzuki, Koutarou
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2024, E107A (03) : 355 - 358
  • [5] MixupExplainer: Generalizing Explanations for Graph Neural Networks with Data Augmentation
    Zhang, Jiaxing
    Luo, Dongsheng
    Wei, Hua
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 3286 - 3296
  • [6] Multichannel Adaptive Data Mixture Augmentation for Graph Neural Networks
    Ye, Zhonglin
    Zhou, Lin
    Li, Mingyuan
    Zhang, Wei
    Liu, Zhen
    Zhao, Haixing
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2024, 20 (01)
  • [7] Metropolis-Hastings Data Augmentation for Graph Neural Networks
    Park, Hyeonjin
    Lee, Seunghun
    Kim, Sihyeon
    Park, Jinyoung
    Jeong, Jisu
    Kim, Kyung-Min
    Ha, Jung-Woo
    Kim, Hyunwoo J.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [8] Spatial Data Augmentation: Improving the Generalization of Neural Networks for Pansharpening
    Chen, Lihui
    Vivone, Gemine
    Nie, Zihao
    Chanussot, Jocelyn
    Yang, Xiaomin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] An Approach to Improving the Effectiveness of Data Augmentation for Deep Neural Networks
    Jang, Seunghui
    Lee, Ki Yong
    Kim, Yanggon
    2020 IEEE 44TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2020), 2020, : 1290 - 1295
  • [10] Local Augmentation for Graph Neural Networks
    Liu, Songtao
    Ying, Rex
    Dong, Hanze
    Li, Lanqing
    Xu, Tingyang
    Rong, Yu
    Zhao, Peilin
    Huang, Junzhou
    Wu, Dinghao
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,