Structure Evolution on Manifold for Graph Learning

被引:3
|
作者
Wan, Hai [1 ]
Zhang, Xinwei [1 ]
Zhang, Yubo [1 ]
Zhao, Xibin [1 ]
Ying, Shihui [3 ]
Gao, Yue [2 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, KLISS, Beijing 100190, Peoples R China
[2] Tsinghua Univ, Sch Software, BNRist, KLISS,THUIBCS & BLBCI, Beijing 100190, Peoples R China
[3] Shanghai Univ, Sch Sci, Dept Math, Shanghai 200444, Peoples R China
关键词
Manifolds; Task analysis; Convolution; Data models; Graph neural networks; Energy measurement; Correlation; structure evolution; graph manifold; graph optimization; graph energy;
D O I
10.1109/TPAMI.2022.3225572
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph has been widely used in various applications, while how to optimize the graph is still an open question. In this paper, we propose a framework to optimize the graph structure via structure evolution on graph manifold. We first define the graph manifold and search the best graph structure on this manifold. Concretely, associated with the data features and the prediction results of a given task, we define a graph energy to measure how the graph fits the graph manifold from an initial graph structure. The graph structure then evolves by minimizing the graph energy. In this process, the graph structure can be evolved on the graph manifold corresponding to the update of the prediction results. Alternatively iterating these two processes, both the graph structure and the prediction results can be updated until converge. It achieves the suitable structure for graph learning without searching all hyperparameters. To evaluate the performance of the proposed method, we have conducted experiments on eight datasets and compared with the recent state-of-the-art methods. Experiment results demonstrate that our method outperforms the state-of-the-art methods in both transductive and inductive settings.
引用
收藏
页码:7751 / 7763
页数:13
相关论文
共 50 条
  • [41] Heterogeneous Graph Structure Learning for Graph Neural Networks
    Zhao, Jianan
    Wang, Xiao
    Shi, Chuan
    Hu, Binbin
    Song, Guojie
    Ye, Yanfang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4697 - 4705
  • [42] Learning graph structure via graph convolutional networks
    Zhang, Qi
    Chang, Jianlong
    Meng, Gaofeng
    Xu, Shibiao
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION, 2019, 95 : 308 - 318
  • [43] Identifying Disease-Gene Associations With Graph-Regularized Manifold Learning
    Luo, Ping
    Xiao, Qianghua
    Wei, Pi-Jing
    Liao, Bo
    Wu, Fang-Xiang
    FRONTIERS IN GENETICS, 2019, 10
  • [44] Robust Graph Meta-Learning via Manifold Calibration with Proxy Subgraphs
    Wang, Zhenzhong
    Cao, Lulu
    Lin, Wanyu
    Jiang, Min
    Tan, Kay Chen
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 12, 2023, : 15224 - 15232
  • [45] Self-Supervised Clustering based on Manifold Learning and Graph Convolutional Networks
    Lopes, Leonardo Tadeu
    Guimaraes Pedronette, Daniel Carlos
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5623 - 5632
  • [46] Manifold-preserving graph reduction for sparse semi-supervised learning
    Sun, Shiliang
    Hussain, Zakria
    Shawe-Taylor, John
    NEUROCOMPUTING, 2014, 124 : 13 - 21
  • [47] Total Variation Constrained Graph Manifold Learning Strategy for Cerenkov Luminescence Tomography
    Guo, Hongbo
    Yu, Jingjing
    He, Xuelei
    Yi, Huangjian
    Hou, Yuqing
    He, Xiaowei
    OPTICS EXPRESS, 2022, 30 (02) : 1422 - 1441
  • [48] UNSUPERVISED MANIFOLD LEARNING BY CORRELATION GRAPH AND STRONGLY CONNECTED COMPONENTS FOR IMAGE RETRIEVAL
    Guimaraes Pedronette, Daniel Carlos
    Torres, Ricardo da S.
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1892 - 1896
  • [49] LEARNING VISUALLY ALIGNED SEMANTIC GRAPH FOR CROSS-MODAL MANIFOLD MATCHING
    Li, Yanan
    Hu, Huanhang
    Wang, Donghui
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3412 - 3416
  • [50] GSLB: The Graph Structure Learning Benchmark
    Li, Zhixun
    Wang, Liang
    Sun, Xin
    Luo, Yifan
    Zhu, Yanqiao
    Chen, Dingshuo
    Luo, Yingtao
    Zhou, Xiangxin
    Liu, Qiang
    Wu, Shu
    Wang, Liang
    Yu, Jeffrey Xu
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,