STOCHASTIC GRAPH NEURAL NETWORKS

被引:0
|
作者
Gao, Zhan [1 ]
Isufi, Elvin [2 ]
Ribeiro, Alejandro [1 ]
机构
[1] Univ Penn, Dept Elect & Syst Engn, Philadelphia, PA 19104 USA
[2] Delft Univ Technol, Dept Intelligent Syst, Delft, Netherlands
关键词
Graph neural networks; graph filters; random link losses; convergence analysis; distributed learning; DESIGN;
D O I
10.1109/icassp40776.2020.9054424
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. However, current GNN implementations assume ideal distributed scenarios and ignore link fluctuations that occur due to environment or human factors. In these situations, the GNN fails to address its distributed task if the topological randomness is not considered accordingly. To overcome this issue, we put forth the stochastic graph neural network (SGNN) model: a GNN where the distributed graph convolutional operator is modified to account for the network changes. Since stochasticity brings in a new paradigm, we develop a novel learning process for the SGNN and introduce the stochastic gradient descent (SGD) algorithm to estimate the parameters. We prove through the SGD that the SGNN learning process converges to a stationary point under mild Lipschitz assumptions. Numerical simulations corroborate the proposed theory and show an improved performance of the SGNN compared with the conventional GNN when operating over random time varying graphs.
引用
收藏
页码:9080 / 9084
页数:5
相关论文
共 50 条
  • [21] Rethinking Graph Regularization for Graph Neural Networks
    Yang, Han
    Ma, Kaili
    Cheng, James
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4573 - 4581
  • [22] Graph Neural Networks with Local Graph Parameters
    Barcelo, Pablo
    Geerts, Floris
    Reutter, Juan
    Ryschkov, Maksimilian
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [23] Semisupervised Graph Neural Networks for Graph Classification
    Xie, Yu
    Liang, Yanfeng
    Gong, Maoguo
    Qin, A. K.
    Ong, Yew-Soon
    He, Tiantian
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (10) : 6222 - 6235
  • [24] Learning graph normalization for graph neural networks
    Chen, Yihao
    Tang, Xin
    Qi, Xianbiao
    Li, Chun-Guang
    Xiao, Rong
    NEUROCOMPUTING, 2022, 493 : 613 - 625
  • [25] Learning Graph Matching with Graph Neural Networks
    Dobler, Kalvin
    Riesen, Kaspar
    ARTIFICIAL NEURAL NETWORKS IN PATTERN RECOGNITION, ANNPR 2024, 2024, 15154 : 3 - 12
  • [26] Stochastic graph as a model for social networks
    Rezvanian, Alireza
    Meybodi, Mohammad Reza
    COMPUTERS IN HUMAN BEHAVIOR, 2016, 64 : 621 - 640
  • [27] Factor Graph Neural Networks
    Zhang, Zhen
    Dupty, Mohammed Haroon
    Wu, Fan
    Shi, Javen Qinfeng
    Lee, Wee Sun
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [28] The Logic of Graph Neural Networks
    Grohe, Martin
    2021 36TH ANNUAL ACM/IEEE SYMPOSIUM ON LOGIC IN COMPUTER SCIENCE (LICS), 2021,
  • [29] Graph Kernel Neural Networks
    Cosmo, Luca
    Minello, Giorgia
    Bicciato, Alessandro
    Bronstein, Michael M.
    Rodola, Emanuele
    Rossi, Luca
    Torsello, Andrea
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 14
  • [30] Benchmarking Graph Neural Networks
    Dwivedi, Vijay Prakash
    Joshi, Chaitanya K.
    Luu, Anh Tuan
    Laurent, Thomas
    Bengio, Yoshua
    Bresson, Xavier
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23