Graph Structure Learning via Lottery Hypothesis at Scale

被引:0
|
作者
Wang, Yuxin [1 ,2 ]
Hu, Xiannian [1 ]
Xie, Jiaqing [3 ]
Yin, Zhangyue [1 ]
Zhou, Yunhua [1 ]
Huang, Xuanjing [1 ,2 ]
Qiu, Xipeng [1 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[2] Fudan Univ, Inst Modern Languages & Linguist, Shanghai, Peoples R China
[3] Swiss Fed Inst Technol, Dept Comp Sci, Zurich, Switzerland
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Graph Neural Networks; Graph Structural Learning; Lottery Hypothesis; Large Scale Graph Learning;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) are commonly applied to analyze real-world graph structured data. However, GNNs are sensitive to the given graph structure, which cast importance on graph structure learning to find optimal graph structures and representations. Previous methods have been restricted from large graphs due to high computational complexity. Lottery ticket hypothesis suggests that there exists a subnetwork that has comparable or better performance with proto-networks, which has been transferred to suit for pruning GNNs recently. There are few studies that address lottery ticket hypothesis's performance on defense in graphs. In this paper, we propose a scalable graph structure learning method leveraging lottery (ticket) hypothesis : GSL-LH. Our experiments show that GSL-LH can outperform its backbone model without attack and show better robustness against attack, achieving state-of-the-art performances in regular-size graphs compared to other graph structure learning methods without feature augmentation. In large graphs, GSL-LH can have comparable results with state-of-the-art defense methods other than graph structure learning, while bringing some insights into explanation of robustness.(1) (2) (3)
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Memory-friendly Scalable Super-resolution via Rewinding Lottery Ticket Hypothesis
    Lin, Jin
    Luo, Xiaotong
    Hong, Ming
    Qu, Yanyun
    Xie, Yuan
    Wu, Zongze
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14398 - 14407
  • [42] Supervised Learning of Graph Structure
    Torsello, Andrea
    Rossi, Luca
    SIMILARITY-BASED PATTERN RECOGNITION: FIRST INTERNATIONAL WORKSHOP, SIMBAD 2011, 2011, 7005 : 117 - 132
  • [43] Supervised Learning of Graph Structure
    Torsello, Andrea
    Rossi, Luca
    SIMILARITY-BASED PATTERN RECOGNITION, 2011, 7005 : 117 - 132
  • [44] Linear Mode Connectivity and the Lottery Ticket Hypothesis
    Frankle, Jonathan
    Dziugaite, Gintare Karolina
    Roy, Daniel M.
    Carbin, Michael
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [45] Optimizing Direct Learning Neural Network Digital Predistortion through the Lottery Ticket Hypothesis Agent
    Loebl, Erez
    Ginzberg, Nimrod
    Cohen, Emanuel
    2024 IEEE/MTT-S INTERNATIONAL MICROWAVE SYMPOSIUM, IMS 2024, 2024, : 192 - 195
  • [46] Linear Mode Connectivity and the Lottery Ticket Hypothesis
    Frankle, Jonathan
    Dziugaite, Gintare Karolina
    Roy, Daniel M.
    Carbin, Michael
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [47] Large-Scale Machine Learning Cluster Scheduling via Multi-Agent Graph Reinforcement Learning
    Zhao, Xiaoyang
    Wu, Chuan
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4962 - 4974
  • [48] Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting
    Ye, Junchen
    Liu, Zihan
    Du, Bowen
    Sun, Leilei
    Li, Weimiao
    Fu, Yanjie
    Xiong, Hui
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2296 - 2306
  • [49] Hierarchical Hypothesis Structure for Ensemble Learning
    Yu, Chu-En
    Liu, Chien-Liang
    Hsieh, Hsin-Lung
    2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017,
  • [50] Image annotation via graph learning
    Liu, Jing
    Li, Mingjing
    Liu, Qingshan
    Lu, Hanqing
    Ma, Songde
    PATTERN RECOGNITION, 2009, 42 (02) : 218 - 228