STOCHASTIC GRAPH NEURAL NETWORKS

被引:0
|
作者
Gao, Zhan [1 ]
Isufi, Elvin [2 ]
Ribeiro, Alejandro [1 ]
机构
[1] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
[2] Delft Univ Technol, Dept Intelligent Syst, Delft, Netherlands
关键词
Graph neural networks; graph filters; random link losses; convergence analysis; distributed learning; DESIGN;
D O I
10.1109/icassp40776.2020.9054424
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. However, current GNN implementations assume ideal distributed scenarios and ignore link fluctuations that occur due to environment or human factors. In these situations, the GNN fails to address its distributed task if the topological randomness is not considered accordingly. To overcome this issue, we put forth the stochastic graph neural network (SGNN) model: a GNN where the distributed graph convolutional operator is modified to account for the network changes. Since stochasticity brings in a new paradigm, we develop a novel learning process for the SGNN and introduce the stochastic gradient descent (SGD) algorithm to estimate the parameters. We prove through the SGD that the SGNN learning process converges to a stationary point under mild Lipschitz assumptions. Numerical simulations corroborate the proposed theory and show an improved performance of the SGNN compared with the conventional GNN when operating over random time varying graphs.
引用
收藏
页码:9080 / 9084
页数:5
相关论文
共 50 条
  • [1] Stochastic Graph Neural Networks
    Gao, Zhan
    Isufi, Elvin
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 4428 - 4443
  • [2] Stochastic Blockmodels meet Graph Neural Networks
    Mehta, Nikhil
    Carin, Lawrence
    Rai, Piyush
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [3] Learning Stochastic Graph Neural Networks With Constrained Variance
    Gao, Zhan
    Isufi, Elvin
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 358 - 371
  • [4] Stability of graph convolutional neural networks to stochastic perturbations
    Gao, Zhan
    Isufi, Elvin
    Ribeiro, Alejandro
    SIGNAL PROCESSING, 2021, 188
  • [5] Dirichlet stochastic weights averaging for graph neural networks
    Park, Minhoi
    Chang, Rakwoo
    Song, Kyungwoo
    APPLIED INTELLIGENCE, 2024, 54 (21) : 10516 - 10524
  • [6] VARIANCE-CONSTRAINED LEARNING FOR STOCHASTIC GRAPH NEURAL NETWORKS
    Gao, Zhan
    Isufi, Elvin
    Ribeiro, Alejandro
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5245 - 5249
  • [7] Graph Stochastic Neural Networks for Semi-supervised Learning
    Wang, Haibo
    Zhou, Chuan
    Chen, Xin
    Wu, Jia
    Pan, Shirui
    Wang, Jilong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [8] Self-Constrained Graph Stochastic Neural Networks for Graphstructure Learning
    Key Lab of Intelligent Perception and Image Understanding of Ministry of Education, International Center of Intelligent Perception and Computation, Xidian University, Xi’an
    710071, China
  • [9] Graph neural networks
    Corso G.
    Stark H.
    Jegelka S.
    Jaakkola T.
    Barzilay R.
    Nature Reviews Methods Primers, 4 (1):
  • [10] Graph neural networks
    不详
    NATURE REVIEWS METHODS PRIMERS, 2024, 4 (01):