Improved Modeling and Generalization Capabilities of Graph Neural Networks With Legendre Polynomials

被引:1
|
作者
Chen, Jiali [1 ]
Xu, Liwen [1 ]
机构
[1] North China Univ Technol, Coll Sci, Beijing 100144, Peoples R China
来源
IEEE ACCESS | 2023年 / 11卷
关键词
LegendreNet; graph neural networks; high-order dependencies; Legendre polynomials; robustness; spectral filtering;
D O I
10.1109/ACCESS.2023.3289002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
LegendreNet is a novel graph neural network (GNNs) model that addresses stability issues present in traditional GNN models such as ChebNet, while also more effectively capturing higher-order dependencies within graphical data. Compared to traditional GNNs models such as GCN, LegendreNet is better equipped to handle large-scale graphical data, demonstrating superior performance on such datasets. Furthermore, Legendre polynomials, which are a set of completely orthogonal polynomials, are capable of approximating any function to arbitrary precision within a bounded interval. As such, when applied to graph neural networks, Legendre polynomials provide a more precise and stable means of fitting spectral filters to graphical data. This enables LegendreNet to more accurately capture graphical features when dealing with complex graphical data, and to exhibit greater robustness in adversarial attack scenarios. Compared to traditional GNNs methods, LegendreNet offers improved modeling and generalization capabilities, making it a more effective solution across various graphical data applications. Our experiments have demonstrated that our model outperforms state-of-the-art methods on large-scale graphical datasets. The code for LegendreNet is available at https://github.com/12chen20/LegendreNet.
引用
收藏
页码:63442 / 63450
页数:9
相关论文
共 50 条
  • [1] Challenging the generalization capabilities of Graph Neural Networks for network modeling
    Suarez-Varela, Jose
    Carol-Bosch, Sergi
    Rusek, Krzysztof
    Almasan, Paul
    Arias, Marta
    Barlet-Ros, Pere
    Cabellos-Aparicio, Albert
    PROCEEDINGS OF THE 2019 ACM SIGCOMM CONFERENCE POSTERS AND DEMOS (SIGCOMM '19), 2019, : 114 - 115
  • [2] Generalization capabilities of translationally equivariant neural networks
    Bulusu, Srinath
    Favoni, Matteo
    Ipp, Andreas
    Mueller, David, I
    Schuh, Daniel
    PHYSICAL REVIEW D, 2021, 104 (07)
  • [3] Computational Capabilities of Graph Neural Networks
    Scarselli, Franco
    Gori, Marco
    Tsoi, Ah Chung
    Hagenbuchner, Markus
    Monfardini, Gabriele
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (01): : 81 - 102
  • [4] Improving generalization capabilities of dynamic neural networks
    Galicki, M
    Leistritz, L
    Zwick, EB
    Witte, H
    NEURAL COMPUTATION, 2004, 16 (06) : 1253 - 1282
  • [5] MELLIN TRANSFORMS OF A GENERALIZATION OF LEGENDRE POLYNOMIALS
    OBERLE, MK
    SCOTT, SL
    GILBERT, GT
    HATCHER, RL
    ADDIS, DF
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1993, 45 (03) : 367 - 369
  • [6] Generalization and Representational Limits of Graph Neural Networks
    Garg, Vikas K.
    Jegelka, Stefanie
    Jaakkola, Tommi
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [7] A Generalization of Recurrent Neural Networks for Graph Embedding
    Han, Xiao
    Zhang, Chunhong
    Guo, Chenchen
    Ji, Yang
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT II, 2018, 10938 : 247 - 259
  • [8] Generalization and Representational Limits of Graph Neural Networks
    Garg, Vikas K.
    Jegelka, Stefanie
    Jaakkola, Tommi
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [9] Stability and Generalization of Graph Convolutional Neural Networks
    Verma, Saurabh
    Zhang, Zhi-Li
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1539 - 1548
  • [10] Learning the dynamic neural networks with the improvement of generalization capabilities
    Galicki, M
    Leistritz, L
    Witte, H
    ARTIFICIAL NEURAL NETWORKS - ICANN 2002, 2002, 2415 : 377 - 382