Brain graph super-resolution using adversarial graph neural network with application to functional brain connectivity

被引:8
|
作者
Isallari, Megi [1 ]
Rekik, Islem [1 ,2 ]
机构
[1] Istanbul Tech Univ, Fac Comp & Informat Engn, BASIRA Lab, Istanbul, Turkey
[2] Univ Dundee, Sch Sci & Engn, Comp, Dundee, Scotland
关键词
Graph super-resolution; Brain connectivity; Graph node embedding; Graph neural network; Spectral upsampling; Adversarial learning;
D O I
10.1016/j.media.2021.102084
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Brain image analysis has advanced substantially in recent years with the proliferation of neuroimaging datasets acquired at different resolutions. While research on brain image super-resolution has undergone a rapid development in the recent years, brain graph super-resolution is still poorly investigated because of the complex nature of non-Euclidean graph data. In this paper, we propose the first-ever deep graph super-resolution (GSR) framework that attempts to automatically generate high-resolution (HR) brain graphs with N ' nodes (i.e., anatomical regions of interest (ROIs)) from low-resolution (LR) graphs with N nodes where N < N ' . First, we formalize our GSR problem as a node feature embedding learning task. Once the HR nodes' embeddings are learned, the pairwise connectivity strength between brain ROIs can be derived through an aggregation rule based on a novel Graph U-Net architecture. While typically the Graph U-Net is a node-focused architecture where graph embedding depends mainly on node attributes, we propose a graph-focused architecture where the node feature embedding is based on the graph topology. Second, inspired by graph spectral theory, we break the symmetry of the U-Net architecture by super-resolving the low-resolution brain graph structure and node content with a GSR layer and two graph convolutional network layers to further learn the node embeddings in the HR graph. Third, to handle the domain shift between the ground-truth and the predicted HR brain graphs, we incorporate adversarial regularization to align their respective distributions. Our proposed AGSR-Net framework outperformed its variants for predicting high-resolution functional brain graphs from low-resolution ones. Our AGSR-Net code is available on GitHub at https://github.com/basiralab/AGSR-Net . (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Relation-consistency graph convolutional network for image super-resolution
    Yang, Yue
    Qi, Yong
    Qi, Saiyu
    VISUAL COMPUTER, 2024, 40 (02): : 619 - 635
  • [32] Relation-consistency graph convolutional network for image super-resolution
    Yue Yang
    Yong Qi
    Saiyu Qi
    The Visual Computer, 2024, 40 (2) : 619 - 635
  • [33] Test-retest Reliability of Functional Connectivity and Graph Metrics in the Resting Brain Network
    Jin, Dan
    Xu, Kaibin
    Liu, Bing
    Jiang, Tianzi
    Liu, Yong
    2018 40TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2018, : 1028 - 1031
  • [34] Brain Functional Network Generation Using Distribution-Regularized Adversarial Graph Autoencoder with Transformer for Dementia Diagnosis
    Zuo, Qiankun
    Hu, Junhua
    Zhang, Yudong
    Pan, Junren
    Jing, Changhong
    Chen, Xuhang
    Meng, Xiaobo
    Hong, Jin
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137 (03): : 2129 - 2147
  • [35] Super-resolution PET imaging using a generative adversarial network
    Song, Tzu-An
    Chowdhury, Samadrita Roy
    El Fakhri, Georges
    Li, Quanzheng
    Dutta, Joyita
    JOURNAL OF NUCLEAR MEDICINE, 2019, 60
  • [36] THEORETICAL GRAPH ANALYSIS OF FUNCTIONAL CONNECTIVITY IN THE HEALTHY AND DISEASED BRAIN
    Bifone, A.
    ALCOHOL AND ALCOHOLISM, 2015, 50
  • [37] Learning Graph Regularisation for Guided Super-Resolution
    de Lutio, Riccardo
    Becker, Alexander
    D'Aronco, Stefano
    Russo, Stefania
    Wegner, Jan D.
    Schindler, Konrad
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1978 - 1987
  • [38] A GROUPWISE SUPER-RESOLUTION APPROACH: APPLICATION TO BRAIN MRI
    Rousseau, F.
    Kim, K.
    Studholme, C.
    2010 7TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2010, : 860 - 863
  • [39] Image super-resolution using conditional generative adversarial network
    Qiao, Jiaojiao
    Song, Huihui
    Zhang, Kaihua
    Zhang, Xiaolu
    Liu, Qingshan
    IET IMAGE PROCESSING, 2019, 13 (14) : 2673 - 2679
  • [40] Image Super-Resolution using a Improved Generative Adversarial Network
    Wang, Han
    Wu, Wei
    Su, Yang
    Duan, Yongsheng
    Wang, Pengze
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 312 - 315