A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis

被引:4
|
作者
Ma, Yulan [1 ]
Cui, Weigang [2 ]
Liu, Jingyu [3 ]
Guo, Yuzhu [1 ]
Chen, Huiling [4 ]
Li, Yang [5 ,6 ]
机构
[1] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Engn Med, Beijing 100191, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[4] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
[5] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[6] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Diseases; Fuses; Brain modeling; Autism; Time series analysis; Organizations; Mild cognitive impairment (MCI); autism spectrum disorder (ASD); deep learning; feature fusion; multi-template; multi-graph cross-attention; CONNECTIVITY; PARCELLATION; ATLAS;
D O I
10.1109/TMI.2023.3327283
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-attention based region-aware feature fusion network (MGCA-RAFFNet) by using multi-template for brain disorder diagnosis. Specifically, we first employ multi-template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:1045 / 1059
页数:15
相关论文
共 46 条
  • [31] Bearing fault diagnosis based on wavelet adaptive threshold filtering and multi-channel fusion cross-attention neural network
    Zhao, Yunji
    Wei, Sicheng
    Xu, Xiaozhuo
    REVIEW OF SCIENTIFIC INSTRUMENTS, 2024, 95 (11):
  • [32] Diagnosis of Schizophrenia Disorder in MR Brain Images Using Multi-objective BPSO Based Feature Selection with Fuzzy SVM
    Latha Manohar
    Kavitha Ganesan
    Journal of Medical and Biological Engineering, 2018, 38 : 917 - 932
  • [33] Diagnosis of Schizophrenia Disorder in MR Brain Images Using Multi-objective BPSO Based Feature Selection with Fuzzy SVM
    Manohar, Latha
    Ganesan, Kavitha
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2018, 38 (06) : 917 - 932
  • [34] KIDBA-Net: A Multi-Feature Fusion Brain Tumor Segmentation Network Utilizing Kernel Inception Depthwise Convolution and Bi-Cross Attention
    Min, Jie
    Huang, Tongyuan
    Huang, Boxiong
    Hu, Chuanxin
    Zhang, Zhixing
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2025, 35 (02)
  • [35] Pulp grade monitoring using binocular image through multi-scale feature cross-attention fusion network and saliency map constraint
    Zhong, Yuze
    Tang, Zhaohui
    Zhang, Hu
    Dai, Zhien
    Nie, Zibang
    Xie, Yongfang
    ADVANCED ENGINEERING INFORMATICS, 2024, 62
  • [36] Graph-based multi-level feature fusion network for diabetic retinopathy grading using ultra-wide-field images
    Zhang, Dan
    Liu, Mengting
    Chen, Fangsheng
    Lu, Qinkang
    Zhao, Yitian
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 93
  • [37] Chatter detection in milling of thin-walled parts using multi-channel feature fusion and temporal attention-based network
    Han, Zhenyu
    Zhuo, Yue
    Yan, Yizhao
    Jin, Hongyu
    Fu, Hongya
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2022, 179
  • [38] Chatter detection in milling of thin-walled parts using multi-channel feature fusion and temporal attention-based network
    Han Z.
    Zhuo Y.
    Yan Y.
    Jin H.
    Fu H.
    Mechanical Systems and Signal Processing, 2022, 179
  • [39] Modality-level cross-connection and attentional feature fusion based deep neural network for multi-modal brain tumor segmentation
    Zhou, Tongxue
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 81
  • [40] Fusion of brain imaging genetic data for alzheimer's disease diagnosis and causal factors identification using multi-stream attention mechanisms and graph convolutional networks
    Peng, Wei
    Ma, Yanhan
    Li, Chunshan
    Dai, Wei
    Fu, Xiaodong
    Liu, Li
    Liu, Lijun
    Liu, Jin
    NEURAL NETWORKS, 2025, 184