Brain graph super-resolution using adversarial graph neural network with application to functional brain connectivity

被引:8
|
作者
Isallari, Megi [1 ]
Rekik, Islem [1 ,2 ]
机构
[1] Istanbul Tech Univ, Fac Comp & Informat Engn, BASIRA Lab, Istanbul, Turkey
[2] Univ Dundee, Sch Sci & Engn, Comp, Dundee, Scotland
关键词
Graph super-resolution; Brain connectivity; Graph node embedding; Graph neural network; Spectral upsampling; Adversarial learning;
D O I
10.1016/j.media.2021.102084
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Brain image analysis has advanced substantially in recent years with the proliferation of neuroimaging datasets acquired at different resolutions. While research on brain image super-resolution has undergone a rapid development in the recent years, brain graph super-resolution is still poorly investigated because of the complex nature of non-Euclidean graph data. In this paper, we propose the first-ever deep graph super-resolution (GSR) framework that attempts to automatically generate high-resolution (HR) brain graphs with N ' nodes (i.e., anatomical regions of interest (ROIs)) from low-resolution (LR) graphs with N nodes where N < N ' . First, we formalize our GSR problem as a node feature embedding learning task. Once the HR nodes' embeddings are learned, the pairwise connectivity strength between brain ROIs can be derived through an aggregation rule based on a novel Graph U-Net architecture. While typically the Graph U-Net is a node-focused architecture where graph embedding depends mainly on node attributes, we propose a graph-focused architecture where the node feature embedding is based on the graph topology. Second, inspired by graph spectral theory, we break the symmetry of the U-Net architecture by super-resolving the low-resolution brain graph structure and node content with a GSR layer and two graph convolutional network layers to further learn the node embeddings in the HR graph. Third, to handle the domain shift between the ground-truth and the predicted HR brain graphs, we incorporate adversarial regularization to align their respective distributions. Our proposed AGSR-Net framework outperformed its variants for predicting high-resolution functional brain graphs from low-resolution ones. Our AGSR-Net code is available on GitHub at https://github.com/basiralab/AGSR-Net . (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] SIMULTANEOUS SUPER-RESOLUTION AND SEGMENTATION USING A GENERATIVE ADVERSARIAL NETWORK: APPLICATION TO NEONATAL BRAIN MRI
    Pham, C-H
    Tor-Diez, C.
    Meunier, H.
    Bednarek, N.
    Fablet, R.
    Passat, N.
    Rousseau, F.
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 991 - 994
  • [2] A GRAPH NEURAL NETWORK FOR MULTIPLE-IMAGE SUPER-RESOLUTION
    Tarasiewicz, Tomasz
    Nalepa, Jakub
    Kawulok, Michal
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1824 - 1828
  • [3] Graph Convolutional Neural Network Based Emotion Recognition with Brain Functional Connectivity Network
    Gao, Pengzhi
    Zheng, Xiangwei
    Wang, Tao
    Zhang, Yuang
    International Journal of Crowd Science, 2024, 8 (04) : 195 - 204
  • [4] LEARNING AN INTRINSIC GRAPH NEURAL NETWORK FOR SARTELLITE VIDEO SUPER-RESOLUTION
    Xiao, Yi
    Su, Xin
    Yuan, Qiangqiang
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3751 - 3753
  • [5] A graph neural network for heterogeneous multi-image super-resolution
    Tarasiewicz, Tomasz
    Kawulok, Michal
    PATTERN RECOGNITION LETTERS, 2025, 189 : 214 - 220
  • [6] Dementia classification using a graph neural network on imaging of effective brain connectivity
    Cao, Jun
    Yang, Lichao
    Sarrigiannis, Ptolemaios Georgios
    Blackburn, Daniel
    Zhao, Yifan
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 168
  • [7] Multi kernel cross sparse graph attention convolutional neural network for brain magnetic resonance imaging super-resolution
    Hua, Xin
    Du, Zhijiang
    Ma, Jixin
    Yu, Hongjian
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [8] Topological Cycle Graph Attention Network for Brain Functional Connectivity
    Huang, Jinghan
    Chen, Nanguang
    Qiu, Anqi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 723 - 732
  • [9] GSR-Net: Graph Super-Resolution Network for Predicting High-Resolution from Low-Resolution Functional Brain Connectomes
    Isallari, Megi
    Rekik, Islem
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2020, 2020, 12436 : 139 - 149
  • [10] Brain multigraph prediction using topology-aware adversarial graph neural network
    Bessadok, Alaa
    Mahjoub, Mohamed Ali
    Rekik, Islem
    MEDICAL IMAGE ANALYSIS, 2021, 72