Adaptive Propagation Graph Convolutional Networks Based on Attention Mechanism

被引:3
|
作者
Zhang, Chenfang [1 ]
Gan, Yong [2 ]
Yang, Ruisen [1 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Comp Commun & Engn, Zhengzhou 450002, Peoples R China
[2] Zhengzhou Inst Engn & Technol, Sch Comp Commun & Engn, Zhengzhou 450002, Peoples R China
关键词
graph neural networks; convolutional network; attention mechanism; adaptive propagation;
D O I
10.3390/info13100471
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The main steps in a graph neural network are message propagation and aggregation between nodes. Message propagation allows messages from distant nodes in the graph to be transmitted to the central node, while feature aggregation allows the central node to obtain messages regarding its neighbors and update itself, so that it can express deep-layer features. Because the graph structure data have no local translation invariance, the number of neighbors of each central node is different, and there is no order, there are two difficulties: (1) how to design a reliable message propagation method to better express all network topologies; (2) how to design a feature aggregation function so that it can weigh local features and global features. In this paper, a new adaptive propagation graph convolutional network model based on the attention mechanism (APAT-GCN) is proposed, which enables GNNs to adaptively complete the process of message propagation and feature aggregation, according to the neighbors of the central node, and set the influence degree of local and global messages on the aggregation of the central node. Compared with other classical models, this method is superior to the baseline model and can improve the accuracy of node- and graph-level classification tasks in downstream tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] DAGCN: Dual Attention Graph Convolutional Networks
    Chen, Fengwen
    Pan, Shirui
    Jiang, Jing
    Huo, Huan
    Long, Guodong
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [22] Robust Clustering Model Based on Attention Mechanism and Graph Convolutional Network
    Xia, Hui
    Shao, Shushu
    Hu, Chunqiang
    Zhang, Rui
    Qiu, Tie
    Xiao, Fu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 5203 - 5215
  • [23] Vulnerability Detection Based on Deep Graph Convolutional Network and Attention Mechanism
    Xiao, Peng
    Zhang, Xusheng
    Yang, Fengyu
    Zheng, Wei
    Computer Engineering and Applications, 1600, 3 (292-305):
  • [24] Reward Propagation Using Graph Convolutional Networks
    Klissarov, Martin
    Precup, Doina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [25] A REGULARIZED ATTENTION MECHANISM FOR GRAPH ATTENTION NETWORKS
    Shanthamallu, Uday Shankar
    Jayaraman, J. Thiagarajan
    Spanias, Andreas
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3372 - 3376
  • [26] Self-Attention Based Sequential Recommendation With Graph Convolutional Networks
    Seng, Dewen
    Wang, Jingchang
    Zhang, Xuefeng
    IEEE ACCESS, 2024, 12 : 32780 - 32787
  • [27] Rotary Machinery Fault Diagnosis Based on Split Attention Mechanism and Graph Convolutional Domain Adaptive Adversarial Network
    Wang, Haitao
    Li, Mingjun
    Liu, Zelin
    Dai, Xiyang
    Wang, Ruihua
    Shi, Lichen
    IEEE SENSORS JOURNAL, 2024, 24 (04) : 5399 - 5413
  • [28] Learning Graph Convolutional Networks Based on Quantum Vertex Information Propagation
    Bai, Lu
    Jiao, Yuhang
    Cui, Lixin
    Rossi, Luca
    Wang, Yue
    Yu, Philip S.
    Hancock, Edwin R.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (02) : 1747 - 1760
  • [29] Accurate and Scalable Graph Convolutional Networks for Recommendation Based on Subgraph Propagation
    Li, Xueqi
    Xiao, Guoqing
    Chen, Yuedan
    Li, Kenli
    Cong, Gao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 7556 - 7568
  • [30] AttPool: Towards Hierarchical Feature Representation in Graph Convolutional Networks via Attention Mechanism
    Huang, Jingjia
    Li, Zhangheng
    Li, Nannan
    Liu, Shan
    Li, Ge
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6489 - 6498