Graph Structure Learning via Lottery Hypothesis at Scale

被引:0
|
作者
Wang, Yuxin [1 ,2 ]
Hu, Xiannian [1 ]
Xie, Jiaqing [3 ]
Yin, Zhangyue [1 ]
Zhou, Yunhua [1 ]
Huang, Xuanjing [1 ,2 ]
Qiu, Xipeng [1 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Fudan Univ, Inst Modern Languages & Linguist, Shanghai, Peoples R China
[3] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph Neural Networks; Graph Structural Learning; Lottery Hypothesis; Large Scale Graph Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) are commonly applied to analyze real-world graph structured data. However, GNNs are sensitive to the given graph structure, which cast importance on graph structure learning to find optimal graph structures and representations. Previous methods have been restricted from large graphs due to high computational complexity. Lottery ticket hypothesis suggests that there exists a subnetwork that has comparable or better performance with proto-networks, which has been transferred to suit for pruning GNNs recently. There are few studies that address lottery ticket hypothesis's performance on defense in graphs. In this paper, we propose a scalable graph structure learning method leveraging lottery (ticket) hypothesis : GSL-LH. Our experiments show that GSL-LH can outperform its backbone model without attack and show better robustness against attack, achieving state-of-the-art performances in regular-size graphs compared to other graph structure learning methods without feature augmentation. In large graphs, GSL-LH can have comparable results with state-of-the-art defense methods other than graph structure learning, while bringing some insights into explanation of robustness.(1) (2) (3)
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Consensus Affinity Graph Learning via Structure Graph Fusion and Block Diagonal Representation for Multiview Clustering
    Gui, Zhongyan
    Yang, Jing
    Xie, Zhiqiang
    Ye, Cuicui
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [32] Semi-supervised feature selection via adaptive structure learning and constrained graph learning
    Lai, Jingliu
    Chen, Hongmei
    Li, Weiyi
    Li, Tianrui
    Wan, Jihong
    KNOWLEDGE-BASED SYSTEMS, 2022, 251
  • [33] Multi-scale object retrieval via learning on graph from multimodal data
    Zhang, Yongsheng
    Yamamoto, Tsuyoshi
    Dobashi, Yoshinori
    NEUROCOMPUTING, 2016, 207 : 684 - 692
  • [34] Semi-Supervised Graph Structure Learning via Dual Reinforcement of Label and Prior Structure
    Yuan, Ruiwen
    Tang, Yongqiang
    Wu, Yajing
    Niu, Jinghao
    Zhang, Wensheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (11) : 6943 - 6956
  • [35] Semi-Supervised Graph Structure Learning via Dual Reinforcement of Label and Prior Structure
    Yuan, Ruiwen
    Tang, Yongqiang
    Wu, Yajing
    Niu, Jinghao
    Zhang, Wensheng
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (11) : 6943 - 6956
  • [36] Unsupervised Graph Embedding via Adaptive Graph Learning
    Zhang, Rui
    Zhang, Yunxing
    Lu, Chengjun
    Li, Xuelong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 5329 - 5336
  • [37] Graph embedding via multi-scale graph representations
    Xie, Yu
    Chen, Cheng
    Gong, Maoguo
    Li, Deyu
    Qin, A. K.
    INFORMATION SCIENCES, 2021, 578 : 102 - 115
  • [38] Few-shot learning via weighted prototypes from graph structure
    Zhou, Yifan
    Yu, learning Lei
    PATTERN RECOGNITION LETTERS, 2023, 176 : 230 - 235
  • [39] Fast and Accurate Lane Detection via Graph Structure and Disentangled Representation Learning
    He, Yulin
    Chen, Wei
    Li, Chen
    Luo, Xin
    Huang, Libo
    SENSORS, 2021, 21 (14)
  • [40] Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification
    Piao, Yinhua
    Lee, Sangseon
    Lee, Dohoon
    Kim, Sun
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 11165 - 11173