Structure Evolution on Manifold for Graph Learning

被引:3
|
作者
Wan, Hai [1 ]
Zhang, Xinwei [1 ]
Zhang, Yubo [1 ]
Zhao, Xibin [1 ]
Ying, Shihui [3 ]
Gao, Yue [2 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, KLISS, Beijing 100190, Peoples R China
[2] Tsinghua Univ, Sch Software, BNRist, KLISS,THUIBCS & BLBCI, Beijing 100190, Peoples R China
[3] Shanghai Univ, Sch Sci, Dept Math, Shanghai 200444, Peoples R China
关键词
Manifolds; Task analysis; Convolution; Data models; Graph neural networks; Energy measurement; Correlation; structure evolution; graph manifold; graph optimization; graph energy;
D O I
10.1109/TPAMI.2022.3225572
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph has been widely used in various applications, while how to optimize the graph is still an open question. In this paper, we propose a framework to optimize the graph structure via structure evolution on graph manifold. We first define the graph manifold and search the best graph structure on this manifold. Concretely, associated with the data features and the prediction results of a given task, we define a graph energy to measure how the graph fits the graph manifold from an initial graph structure. The graph structure then evolves by minimizing the graph energy. In this process, the graph structure can be evolved on the graph manifold corresponding to the update of the prediction results. Alternatively iterating these two processes, both the graph structure and the prediction results can be updated until converge. It achieves the suitable structure for graph learning without searching all hyperparameters. To evaluate the performance of the proposed method, we have conducted experiments on eight datasets and compared with the recent state-of-the-art methods. Experiment results demonstrate that our method outperforms the state-of-the-art methods in both transductive and inductive settings.
引用
收藏
页码:7751 / 7763
页数:13
相关论文
共 50 条
  • [31] Active learning of Gaussian processes with manifold-preserving graph reduction
    Zhou, Jin
    Sun, Shiliang
    NEURAL COMPUTING & APPLICATIONS, 2014, 25 (7-8): : 1615 - 1625
  • [32] A correlation graph approach for unsupervised manifold learning in image retrieval tasks
    Guimaraes Pedronette, Daniel Carlos
    Torres, Ricardo da S.
    NEUROCOMPUTING, 2016, 208 : 66 - 79
  • [33] Manifold learning using robust Graph Laplacian for interactive image search
    Sahbi, Hichem
    Etyngier, Patrick
    Audibert, Jean-Yves
    Keriven, Renaud
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2205 - +
  • [34] Visual Object Tracking via Graph Learning and Flexible Manifold Ranking
    Jiang, Bo
    Lin, Doudou
    Tang, Jin
    Luo, Bin
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT I, 2018, 11164 : 313 - 323
  • [35] Discriminant Manifold Learning with Graph Convolution Based Regression for Image Classification
    Zhu, Ruifeng
    Dornaika, Fadi
    Ruichek, Yassine
    GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, GBRPR 2019, 2019, 11510 : 226 - 236
  • [36] Graph Convolution Networks with manifold regularization for semi-supervised learning
    Kejani, M. Tavassoli
    Dornaika, F.
    Talebi, H.
    NEURAL NETWORKS, 2020, 127 : 160 - 167
  • [37] Semi-Supervised Learning with Density-Sensitive Manifold Graph
    Wang, Zheng
    Zhao, Yao
    Wei, Shikui
    2010 IEEE 10TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS (ICSP2010), VOLS I-III, 2010, : 1331 - 1334
  • [38] DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion
    Han, Zhen
    Chen, Peng
    Ma, Yunpu
    Tresp, Volker
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 7301 - 7316
  • [39] Efficient Local Coherent Structure Learning via Self-Evolution Bipartite Graph
    Wang, Zheng
    Li, Qi
    Nie, Feiping
    Wang, Rong
    Wang, Fei
    Li, Xuelong
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (08) : 4527 - 4538
  • [40] Graph Structure Learning for Robust Graph Neural Networks
    Jin, Wei
    Ma, Yao
    Liu, Xiaorui
    Tang, Xianfeng
    Wang, Suhang
    Tang, Jiliang
    KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 66 - 74