Transferable graph neural networks with deep alignment attention

被引:2
|
作者
Xie, Ying [1 ,2 ]
Xu, Rongbin [1 ,2 ]
Yang, Yun [3 ]
机构
[1] Putian Univ, Sch Mech Elect & Informat Engn, Putian, Peoples R China
[2] Fujian Key Lab Financial Informat Proc, Fujian, Peoples R China
[3] Swinburne Univ Technol, Dept Comp Technol, Melbourne, Australia
基金
中国国家自然科学基金;
关键词
GNNs; Transfer learning; Attention mechanism;
D O I
10.1016/j.ins.2023.119232
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When analyzing graph-structured data, graph neural networks (GNNs) use well-designed propagation mechanism to extract node features. However, these methods only incorporate data from nodes' fixed neighborhoods or whole graph, not accounting for the influence of important nodes outside of the neighborhoods. We offer transferable graph neural networks with deep alignment attention (TGDAA), which is a novel neural network framework that designs aligned attention to assign different weights to related important nodes. In such a scenario, we concurrently remove a number of graph neural network obstacles and make TGDAA accessible for transfer learning issues. Extensive experiments in four aspects: traditional metrics, attention -related methods, varying label rates and ablation study show that the suggested TGDAA performs better than ten state-of-the-art techniques on ten benchmark network datasets.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Transferable Implicit Solvation via Contrastive Learning of Graph Neural Networks
    Airas, Justin
    Ding, Xinqiang
    Zhang, Bin
    ACS CENTRAL SCIENCE, 2023, 9 (12) : 2286 - 2297
  • [22] Scalable Graph Neural Networks with Deep Graph Library
    Zheng, Da
    Wang, Minjie
    Gan, Quan
    Song, Xiang
    Zhang, Zheng
    Karypis, Geroge
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 1141 - 1142
  • [23] Dynamic Graph Segmentation for Deep Graph Neural Networks
    Kang, Johan Kok Zhi
    Yang, Suwei
    Venkatesan, Suriya
    Tan, Sien Yi
    Cheng, Feng
    He, Bingsheng
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 4601 - 4611
  • [24] Learning Graph Neural Networks with Deep Graph Library
    Zheng, Da
    Wang, Minjie
    Gan, Quan
    Zhang, Zheng
    Karypis, George
    WWW'20: COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2020, 2020, : 305 - 306
  • [25] Scalable Graph Neural Networks with Deep Graph Library
    Zheng, Da
    Wang, Minjie
    Gan, Quan
    Zhang, Zheng
    Karypis, Geroge
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 3521 - 3522
  • [26] Visual Attention with Deep Neural Networks
    Canziani, Alfredo
    Culurciello, Eugenio
    2015 49TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2015,
  • [27] Projective Ranking: A Transferable Evasion Attack Method on Graph Neural Networks
    Zhang, He
    Wu, Bang
    Yang, Xiangwen
    Zhou, Chuan
    Wang, Shuo
    Yuan, Xingliang
    Pan, Shirui
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3617 - 3621
  • [28] Transferable Normalization: Towards Improving Transferability of Deep Neural Networks
    Wang, Ximei
    Jin, Ying
    Long, Mingsheng
    Wang, Jianmin
    Jordan, Michael I.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [29] Vulnerability Intelligence Alignment via Masked Graph Attention Networks
    Qin, Yue
    Xiao, Yue
    Liao, Xiaojing
    PROCEEDINGS OF THE 2023 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, CCS 2023, 2023, : 2202 - 2216
  • [30] Supervised biological network alignment with graph neural networks
    Ding, Kerr
    Wang, Sheng
    Luo, Yunan
    BIOINFORMATICS, 2023, 39 : i465 - i474