Graph Structure Learning via Lottery Hypothesis at Scale

被引:0
|
作者
Wang, Yuxin [1 ,2 ]
Hu, Xiannian [1 ]
Xie, Jiaqing [3 ]
Yin, Zhangyue [1 ]
Zhou, Yunhua [1 ]
Huang, Xuanjing [1 ,2 ]
Qiu, Xipeng [1 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Fudan Univ, Inst Modern Languages & Linguist, Shanghai, Peoples R China
[3] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph Neural Networks; Graph Structural Learning; Lottery Hypothesis; Large Scale Graph Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) are commonly applied to analyze real-world graph structured data. However, GNNs are sensitive to the given graph structure, which cast importance on graph structure learning to find optimal graph structures and representations. Previous methods have been restricted from large graphs due to high computational complexity. Lottery ticket hypothesis suggests that there exists a subnetwork that has comparable or better performance with proto-networks, which has been transferred to suit for pruning GNNs recently. There are few studies that address lottery ticket hypothesis's performance on defense in graphs. In this paper, we propose a scalable graph structure learning method leveraging lottery (ticket) hypothesis : GSL-LH. Our experiments show that GSL-LH can outperform its backbone model without attack and show better robustness against attack, achieving state-of-the-art performances in regular-size graphs compared to other graph structure learning methods without feature augmentation. In large graphs, GSL-LH can have comparable results with state-of-the-art defense methods other than graph structure learning, while bringing some insights into explanation of robustness.(1) (2) (3)
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Long-tailed graph neural networks via graph structure learning for node classification
    Junchao Lin
    Yuan Wan
    Jingwen Xu
    Xingchen Qi
    Applied Intelligence, 2023, 53 : 20206 - 20222
  • [22] Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting
    Wu, Lirong
    Lin, Haitao
    Zhao, Guojiang
    Tan, Cheng
    Li, Stan Z.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [23] Long-tailed graph neural networks via graph structure learning for node classification
    Lin, Junchao
    Wan, Yuan
    Xu, Jingwen
    Qi, Xingchen
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20206 - 20222
  • [24] The Lottery Ticket Hypothesis for Object Recognition
    Girish, Sharath
    Maiya, Shishira R.
    Gupta, Kamal
    Chen, Hao
    Davis, Larry
    Shrivastava, Abhinav
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 762 - 771
  • [25] Lottery Hypothesis based Unsupervised Pre-training for Model Compression in Federated Learning
    Itahara, Sohei
    Nishio, Takayuki
    Morikura, Masahiro
    Yamamoto, Koji
    2020 IEEE 92ND VEHICULAR TECHNOLOGY CONFERENCE (VTC2020-FALL), 2020,
  • [26] RETHINKING GRAPH LOTTERY TICKETS: GRAPH SPARSITY MATTERS
    Hui, Bo
    Yan, Da
    Ma, Xiaolong
    Ku, Wei-Shinn
    arXiv, 2023,
  • [27] GRAHIES: Multi-Scale Graph Representation Learning with Latent Hierarchical Structure
    Yutt, Lei
    Lint, Ling
    Put, Calton
    Chowt, Ka Ho
    Gursoyt, Mehmet Emre
    Truext, Stacey
    Mini, Hong
    Iyengart, Arun
    Slit, Gong
    Zhangt, Qi
    Dillenbergert, Donna
    2019 IEEE FIRST INTERNATIONAL CONFERENCE ON COGNITIVE MACHINE INTELLIGENCE (COGMI 2019), 2019, : 8 - 15
  • [28] Learning dynamic and multi-scale graph structure for traffic demand prediction
    Peng, Lilan
    Li, Chongshou
    Zhang, Wuyang
    Yu, Weijie
    Li, Tianrui
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [29] Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning
    Duan, Jingcan
    Zhang, Pei
    Wang, Siwei
    Hu, Jingtao
    Jin, Hu
    Zhang, Jiaxin
    Zhou, Haifang
    Liu, Xinwang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7502 - 7511
  • [30] Large-Scale Video Hashing via Structure Learning
    Ye, Guangnan
    Liu, Dong
    Wang, Jun
    Chang, Shih-Fu
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 2272 - 2279