A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis

被引:4
|
作者
Ma, Yulan [1 ]
Cui, Weigang [2 ]
Liu, Jingyu [3 ]
Guo, Yuzhu [1 ]
Chen, Huiling [4 ]
Li, Yang [5 ,6 ]
机构
[1] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Engn Med, Beijing 100191, Peoples R China
[3] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[4] Wenzhou Univ, Coll Comp Sci & Artificial Intelligence, Wenzhou 325035, Peoples R China
[5] Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[6] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Diseases; Fuses; Brain modeling; Autism; Time series analysis; Organizations; Mild cognitive impairment (MCI); autism spectrum disorder (ASD); deep learning; feature fusion; multi-template; multi-graph cross-attention; CONNECTIVITY; PARCELLATION; ATLAS;
D O I
10.1109/TMI.2023.3327283
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-attention based region-aware feature fusion network (MGCA-RAFFNet) by using multi-template for brain disorder diagnosis. Specifically, we first employ multi-template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:1045 / 1059
页数:15
相关论文
共 46 条
  • [1] A Multi-Template Fusion Object Tracking Algorithm Based on Graph Attention Network
    Lu, Xiaofeng
    Li, Xiaopeng
    Wang, Zhengyang
    Hei, Xinhong
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2023, 18 (02) : 243 - 253
  • [2] On cross-attention-based graph neural networks for fault diagnosis using multi-sensor measurement
    Ren, Zhenxing
    Zhou, Yu
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2025,
  • [3] RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor Segmentation
    Ding, Yuhang
    Yu, Xin
    Yang, Yi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3955 - 3964
  • [4] Cross-Attention Fusion Based Spatial-Temporal Multi-Graph Convolutional Network for Traffic Flow Prediction
    Yu, Kun
    Qin, Xizhong
    Jia, Zhenhong
    Du, Yan
    Lin, Mengmeng
    SENSORS, 2021, 21 (24)
  • [5] Cross-attention fusion based spatial-temporal multi-graph convolutional network for traffic flow prediction
    College of Information Science and Engineering, Xinjiang University, Urumqi
    830000, China
    Sensors, 1600, 24
  • [6] Voxelwise-based Brain Function Network using Multi-Graph Model
    Wang, Zhongyang
    Xin, Junchang
    Wang, Xinlei
    Wang, Zhiqiong
    Zhao, Yue
    Qian, Wei
    SCIENTIFIC REPORTS, 2018, 8
  • [7] Voxelwise-based Brain Function Network using Multi-Graph Model
    Wang Z.
    Xin J.
    Wang X.
    Wang Z.
    Zhao Y.
    Qian W.
    Scientific Reports, 8 (1)
  • [8] MFFCG-Multi feature fusion for hyperspectral image classification using graph attention network
    Bhatti, Uzair Aslam
    Huang, Mengxing
    Neira-Molina, Harold
    Marjan, Shah
    Baryalai, Mehmood
    Tang, Hao
    Wu, Guilu
    Bazai, Sibghat Ullah
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 229
  • [9] Rotating Machinery Fault Diagnosis Based on Multi-sensor Information Fusion Using Graph Attention Network
    Li, Chenyang
    Kwoh, Chee Keong
    Li, Xiaoli
    Mo, Lingfei
    Yan, Ruqiang
    2022 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV), 2022, : 678 - 683
  • [10] Spectral Graph Neural Network-Based Multi-Atlas Brain Network Fusion for Major Depressive Disorder Diagnosis
    Lee, Deok-Joong
    Shin, Dong-Hee
    Son, Young-Han
    Han, Ji-Wung
    Oh, Ji-Hye
    Kim, Da-Hyun
    Jeong, Ji-Hoon
    Kam, Tae-Eui
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (05) : 2967 - 2978