A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis

被引:4
|
作者
Ma, Yulan [1 ]
Cui, Weigang [2 ]
Liu, Jingyu [3 ]
Guo, Yuzhu [1 ]
Chen, Huiling [4 ]
Li, Yang [5 ,6 ]
机构
[1] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Engn Med, Beijing 100191, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[4] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
[5] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[6] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Diseases; Fuses; Brain modeling; Autism; Time series analysis; Organizations; Mild cognitive impairment (MCI); autism spectrum disorder (ASD); deep learning; feature fusion; multi-template; multi-graph cross-attention; CONNECTIVITY; PARCELLATION; ATLAS;
D O I
10.1109/TMI.2023.3327283
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-attention based region-aware feature fusion network (MGCA-RAFFNet) by using multi-template for brain disorder diagnosis. Specifically, we first employ multi-template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:1045 / 1059
页数:15
相关论文
共 46 条
  • [21] Brain graph super-resolution for boosting neurological disorder diagnosis using unsupervised multi-topology connectional brain template learning
    Mhiri, Islem
    Ben Khalifa, Anouar
    Mahjoub, Mohamed Ali
    Rekik, Islem
    MEDICAL IMAGE ANALYSIS, 2020, 65
  • [22] Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism
    Zhou, Qian
    Xia, Haoran
    Yan, Hongzheng
    Yang, Ming
    Chen, Shidong
    2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 307 - 316
  • [23] Early Diagnosis of Alzheimer's Disease Using 3D Residual Attention Network Based on Hippocampal Multi-indices Feature Fusion
    Zhang, Yiyu
    Zheng, Qiang
    Zhao, Kun
    Li, Honglun
    Ma, Chaoqing
    Wu, Shuanhu
    Tong, Xiangrong
    PATTERN RECOGNITION AND COMPUTER VISION,, PT III, 2021, 13021 : 449 - 457
  • [24] Machinery multi-sensor fault diagnosis based on adaptive multivariate feature mode decomposition and multi-attention fusion residual convolutional neural network
    Yan, Xiaoan
    Yan, Wang-Ji
    Xu, Yadong
    Yuen, Ka-Veng
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2023, 202
  • [25] Autism spectrum disorder diagnosis using graph attention network based on spatial-constrained sparse functional brain networks
    Yang, Chunde
    Wang, Panyu
    Tan, Jia
    Liu, Qingshui
    Li, Xinwei
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 139
  • [26] A Novel Multi-Feature Fusion Network With Spatial Partitioning Strategy and Cross-Attention for Armband-Based Gesture Recognition
    Hu, Fo
    Qian, Mengyuan
    He, Kailun
    Zhang, Wen-An
    Yang, Xusheng
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 3878 - 3890
  • [27] Joint adaptive transfer learning network for cross-domain fault diagnosis based on multi-layer feature fusion
    Jiang, Yimin
    Xia, Tangbin
    Wang, Dong
    Zhang, Kaigan
    Xi, Lifeng
    NEUROCOMPUTING, 2022, 487 : 228 - 242
  • [28] HAGCN: A hybrid-order brain network-based graph convolution learning framework with multi-head attention for brain disorder classification
    Wu, Xubin
    Wen, Xin
    Sun, Jie
    Dong, Yanqing
    Wu, Chenyu
    Wang, Bin
    Xiang, Jie
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [29] Fusing multi-scale fMRI features using a brain-inspired multi-channel graph neural network for major depressive disorder diagnosis
    Liu, Shuai
    Gui, Renzhou
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 90
  • [30] Attention-based multi-scale feature fusion network for myopia grading using optical coherence tomography images
    Huang, Gengyou
    Wen, Yang
    Qian, Bo
    Bi, Lei
    Chen, Tingli
    Sheng, Bin
    VISUAL COMPUTER, 2024, 40 (09): : 6627 - 6638