Adaptive Multi-Channel Deep Graph Neural Networks

被引:1
|
作者
Wang, Renbiao [1 ,2 ]
Li, Fengtai [1 ]
Liu, Shuwei [1 ]
Li, Weihao [3 ]
Chen, Shizhan [1 ]
Feng, Bin [1 ]
Jin, Di [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[2] Tianjin Univ Technol, Dept Comp Engn, Zhonghuan Informat Coll, Tianjin 300380, Peoples R China
[3] Commonwealth Sci & Ind Res Org CSIRO, Data61, Canberra, ACT 2601, Australia
来源
SYMMETRY-BASEL | 2024年 / 16卷 / 04期
关键词
graph neural networks; graph representation learning; over-smoothing;
D O I
10.3390/sym16040406
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Graph neural networks (GNNs) have shown significant success in graph representation learning. However, the performance of existing GNNs degrades seriously when their layers deepen due to the over-smoothing issue. The node embedding incline converges to a certain value when GNNs repeat, aggregating the representations of the receptive field. The main reason for over-smoothing is that the receptive field of each node tends to be similar as the layers increase, which leads to different nodes aggregating similar information. To solve this problem, we propose an adaptive multi-channel deep graph neural network (AMD-GNN) to adaptively and symmetrically aggregate information from the deep receptive field. The proposed model ensures that the receptive field of each node in the deep layer is different so that the node representations are distinguishable. The experimental results demonstrate that AMD-GNN achieves state-of-the-art performance on node classification tasks with deep models.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] JOINT TRAINING OF DEEP NEURAL NETWORKS FOR MULTI-CHANNEL DEREVERBERATION AND SPEECH SOURCE SEPARATION
    Togami, Masahito
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3032 - 3036
  • [22] Visual-LiDAR SLAM Based on Unsupervised Multi-channel Deep Neural Networks
    Yi An
    Jin Shi
    Dongbing Gu
    Qiang Liu
    Cognitive Computation, 2022, 14 : 1496 - 1508
  • [23] MuchSUM: Multi-channel Graph Neural Network for Extractive Summarization
    Mao, Qianren
    Zhu, Hongdong
    Liu, Junnan
    Ji, Cheng
    Peng, Hao
    Li, Jianxin
    Wang, Lihong
    Wang, Zheng
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2617 - 2622
  • [24] A Multi-Channel Deep Neural Network for Relation Extraction
    Chen, Yanping
    Wang, Kai
    Yang, Weizhe
    Qin, Yongbin
    Huang, Ruizhang
    Chen, Ping
    IEEE ACCESS, 2020, 8 : 13195 - 13203
  • [25] Adaptive Multi-Channel CTP for Wireless Sensor Networks
    Phokaew, Aitthiwat
    Tanwongvarl, Chayaphon
    Chantaraskul, Soamsiri
    2014 INTERNATIONAL ELECTRICAL ENGINEERING CONGRESS (IEECON), 2014,
  • [26] DEEP BEAMFORMING NETWORKS FOR MULTI-CHANNEL SPEECH RECOGNITION
    Xiao, Xiong
    Watanabe, Shinji
    Erdogan, Hakan
    Lu, Liang
    Hershey, John
    Seltzer, Michael L.
    Chen, Guoguo
    Zhang, Yu
    Mandel, Michael
    Yu, Dong
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 5745 - 5749
  • [27] Judge Neural Networks for Multi-channel Retailing Competition
    Lv, Hairong
    Bai, Xinxin
    Yin, Wenjun
    Dong, Jin
    Huang, Xiaolin
    IEEE/SOLI'2008: PROCEEDINGS OF 2008 IEEE INTERNATIONAL CONFERENCE ON SERVICE OPERATIONS AND LOGISTICS, AND INFORMATICS, VOLS 1 AND 2, 2008, : 2633 - +
  • [28] Channel and model selection for multi-channel EEG input to neural networks
    Harachi, Kento
    Yamamoto, Yusuke
    Muramatsu, Ayumi
    Nagahara, Hajime
    Takemura, Noriko
    Shimojo, Shinji
    Furihata, Daisuke
    Mizuno-Matsumoto, Yuko
    SICE JOURNAL OF CONTROL MEASUREMENT AND SYSTEM INTEGRATION, 2024, 17 (01)
  • [29] Adaptive weight multi-channel center similar deep hashing
    Liu, Xinghua
    Cao, Guitao
    Lin, Qiubin
    Cao, Wenming
    Journal of Visual Communication and Image Representation, 2022, 89
  • [30] Adaptive weight multi-channel center similar deep hashing
    Liu, Xinghua
    Cao, Guitao
    Lin, Qiubin
    Cao, Wenming
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 89