Structure Evolution on Manifold for Graph Learning

被引:3
|
作者
Wan, Hai [1 ]
Zhang, Xinwei [1 ]
Zhang, Yubo [1 ]
Zhao, Xibin [1 ]
Ying, Shihui [3 ]
Gao, Yue [2 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, KLISS, Beijing 100190, Peoples R China
[2] Tsinghua Univ, Sch Software, BNRist, KLISS,THUIBCS & BLBCI, Beijing 100190, Peoples R China
[3] Shanghai Univ, Sch Sci, Dept Math, Shanghai 200444, Peoples R China
关键词
Manifolds; Task analysis; Convolution; Data models; Graph neural networks; Energy measurement; Correlation; structure evolution; graph manifold; graph optimization; graph energy;
D O I
10.1109/TPAMI.2022.3225572
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph has been widely used in various applications, while how to optimize the graph is still an open question. In this paper, we propose a framework to optimize the graph structure via structure evolution on graph manifold. We first define the graph manifold and search the best graph structure on this manifold. Concretely, associated with the data features and the prediction results of a given task, we define a graph energy to measure how the graph fits the graph manifold from an initial graph structure. The graph structure then evolves by minimizing the graph energy. In this process, the graph structure can be evolved on the graph manifold corresponding to the update of the prediction results. Alternatively iterating these two processes, both the graph structure and the prediction results can be updated until converge. It achieves the suitable structure for graph learning without searching all hyperparameters. To evaluate the performance of the proposed method, we have conducted experiments on eight datasets and compared with the recent state-of-the-art methods. Experiment results demonstrate that our method outperforms the state-of-the-art methods in both transductive and inductive settings.
引用
收藏
页码:7751 / 7763
页数:13
相关论文
共 50 条
  • [1] Manifold structure in graph embeddings
    Rubin-Delanchy, Patrick
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] Adaptive Graph Construction for Isomap Manifold Learning
    Loc Tran
    Zheng, Zezhong
    Zhou, Guoqing
    Li, Jiang
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS XIII, 2015, 9399
  • [3] Divergence Based Graph Estimation for Manifold Learning
    Abou-Moustafa, Karim T.
    Ferrie, Frank
    Schuurmans, Dale
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 447 - 450
  • [4] Smoother manifold for graph meta-learning
    赵文仓
    WANG Chunxin
    XU Changkai
    High Technology Letters, 2022, 28 (01) : 48 - 55
  • [5] Smoother manifold for graph meta-learning
    Zhao W.
    Wang C.
    Xu C.
    High Technology Letters, 2022, 28 (01) : 48 - 55
  • [6] Multi-view graph structure learning using subspace merging on Grassmann manifold
    Ghiasi, Razieh
    Amirkhani, Hossein
    Bosaghzadeh, Alireza
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (11) : 17135 - 17157
  • [7] Multi-view graph structure learning using subspace merging on Grassmann manifold
    Razieh Ghiasi
    Hossein Amirkhani
    Alireza Bosaghzadeh
    Multimedia Tools and Applications, 2023, 82 : 17135 - 17157
  • [8] Supervised hierarchical neighborhood graph construction for manifold learning
    Aeini, Faraein
    Moghadam, Amir Masoud Eftekhari
    Mahmoudi, Fariborz
    SIGNAL IMAGE AND VIDEO PROCESSING, 2018, 12 (04) : 799 - 807
  • [9] Concept factorization with adaptive graph learning on Stiefel manifold
    Hu, Xuemin
    Xiong, Dan
    Chai, Li
    APPLIED INTELLIGENCE, 2024, 54 (17-18) : 8224 - 8240
  • [10] Manifold learning algorithms based on spectral graph theory
    Luo, Siwei
    Zhao, Lianwei
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2006, 43 (07): : 1173 - 1179