Transferable graph neural networks with deep alignment attention

被引:2
|
作者
Xie, Ying [1 ,2 ]
Xu, Rongbin [1 ,2 ]
Yang, Yun [3 ]
机构
[1] Putian Univ, Sch Mech Elect & Informat Engn, Putian, Peoples R China
[2] Fujian Key Lab Financial Informat Proc, Fujian, Peoples R China
[3] Swinburne Univ Technol, Dept Comp Technol, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
GNNs; Transfer learning; Attention mechanism;
D O I
10.1016/j.ins.2023.119232
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When analyzing graph-structured data, graph neural networks (GNNs) use well-designed propagation mechanism to extract node features. However, these methods only incorporate data from nodes' fixed neighborhoods or whole graph, not accounting for the influence of important nodes outside of the neighborhoods. We offer transferable graph neural networks with deep alignment attention (TGDAA), which is a novel neural network framework that designs aligned attention to assign different weights to related important nodes. In such a scenario, we concurrently remove a number of graph neural network obstacles and make TGDAA accessible for transfer learning issues. Extensive experiments in four aspects: traditional metrics, attention -related methods, varying label rates and ablation study show that the suggested TGDAA performs better than ten state-of-the-art techniques on ten benchmark network datasets.
引用
收藏
页数:15
相关论文
共 50 条
  • [11] Luring Transferable Adversarial Perturbations for Deep Neural Networks
    Bernhard, Remi
    Moellic, Pierre-Alain
    Dutertre, Jean-Max
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [12] Conceptual alignment deep neural networks
    Dai, Yinglong
    Wang, Guojun
    Li, Kuan-Ching
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 34 (03) : 1631 - 1642
  • [13] Temporal Alignment for Deep Neural Networks
    Lin, Payton
    Lyu, Dau-Cheng
    Chang, Yun-Fan
    Tsao, Yu
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 108 - 112
  • [14] Social network alignment: a bi-layer graph attention neural networks based method
    Meilian Lu
    Yinlong Dai
    Zhiqiang Zhang
    Applied Intelligence, 2022, 52 : 16310 - 16333
  • [15] Social network alignment: a bi-layer graph attention neural networks based method
    Lu, Meilian
    Dai, Yinlong
    Zhang, Zhiqiang
    APPLIED INTELLIGENCE, 2022, 52 (14) : 16310 - 16333
  • [16] Transferable Graph Neural Networks for Inferring Road Type Attributes in Street Networks
    Iddianozie, Chidubem
    Mcardle, Gavin
    IEEE ACCESS, 2021, 9 : 158331 - 158339
  • [17] Graph Attention Networks for Neural Social Recommendation
    Mu, Nan
    Zha, Daren
    He, Yuanye
    Tang, Zhihao
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1320 - 1327
  • [18] Fast and Deep Graph Neural Networks
    Gallicchio, Claudio
    Micheli, Alessio
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3898 - 3905
  • [19] Understanding Attention and Generalization in Graph Neural Networks
    Knyazev, Boris
    Taylor, Graham W.
    Amer, Mohamed R.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [20] Search for deep graph neural networks
    Feng, Guosheng
    Wang, Hongzhi
    Wang, Chunnan
    INFORMATION SCIENCES, 2023, 649