Alzheimer's disease diagnosis from multi-modal data via feature inductive learning and dual multilevel graph neural network

被引:3
|
作者
Lei, Baiying [1 ]
Li, Yafeng [1 ]
Fu, Wanyi [2 ]
Yang, Peng [1 ]
Chen, Shaobin [1 ]
Wang, Tianfu [1 ]
Xiao, Xiaohua [3 ]
Niu, Tianye [4 ]
Fu, Yu [5 ]
Wang, Shuqiang [6 ]
Han, Hongbin [7 ,8 ]
Qin, Jing [9 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Marshall Lab Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound,Med, Shenzhen 518060, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing Key Lab Magnet Resonance Imaging Devices, Beijing, Peoples R China
[3] Shenzhen Univ, Med Sch, Affiliated Hosp 1, Shenzhen Peoples Hosp 2, Shenzhen 530031, Peoples R China
[4] Shenzhen Bay Lab, Shenzhen 518067, Peoples R China
[5] Peking Univ Third Hosp, Dept Neurol, 49 North Garden Rd, Beijing 100191, Peoples R China
[6] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[7] Peking Univ Third Hosp, Peking Univ Hlth Sci Ctr, Inst Med Technol, Dept Radiol,Beijing Key Lab Magnet Resonance Imag, Beijing 100191, Peoples R China
[8] Dalian Med Univ, Hosp 2, Res & Developing Ctr Med Technol, Dalian 116027, Peoples R China
[9] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Alzheimer's disease analysis; Feature inductive learning; Dual multilevel graph neural network; Multi-modal data; CANONICAL CORRELATION-ANALYSIS; CONVOLUTIONAL NETWORK; CLASSIFICATION; ASSOCIATION; PREDICTION; VARIANTS;
D O I
10.1016/j.media.2024.103213
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -modal data can provide complementary information of Alzheimer's disease (AD) and its development from different perspectives. Such information is closely related to the diagnosis, prevention, and treatment of AD, and hence it is necessary and critical to study AD through multi -modal data. Existing learning methods, however, usually ignore the influence of feature heterogeneity and directly fuse features in the last stages. Furthermore, most of these methods only focus on local fusion features or global fusion features, neglecting the complementariness of features at different levels and thus not sufficiently leveraging information embedded in multi -modal data. To overcome these shortcomings, we propose a novel framework for AD diagnosis that fuses gene, imaging, protein, and clinical data. Our framework learns feature representations under the same feature space for different modalities through a feature induction learning (FIL) module, thereby alleviating the impact of feature heterogeneity. Furthermore, in our framework, local and global salient multi -modal feature interaction information at different levels is extracted through a novel dual multilevel graph neural network (DMGNN). We extensively validate the proposed method on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and experimental results demonstrate our method consistently outperforms other state-of-the-art multi -modal fusion methods. The code is publicly available on the GitHub website. (https: //github.com/xiankantingqianxue/MIA-code.git)
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Longitudinal and Multi-modal Data Learning for Parkinson's Disease Diagnosis via Stacked Sparse Auto-encoder
    Li, Shiqi
    Lei, Haijun
    Zhou, Feng
    Gardezi, Jamal
    Lei, Baiying
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 384 - 387
  • [42] Multi-modal neuroimaging feature fusion via 3D Convolutional Neural Network architecture for schizophrenia diagnosis
    Masoudi, Babak
    Daneshvar, Sabalan
    Razavi, Seyed Naser
    INTELLIGENT DATA ANALYSIS, 2021, 25 (03) : 527 - 540
  • [43] MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data
    Guan, Hao
    Wang, Chaoyue
    Tao, Dacheng
    NEUROIMAGE, 2021, 244
  • [44] Machine learning on longitudinal multi-modal data enables the understanding and prognosis of Alzheimer's disease progression
    Zhang, Suixia
    Yuan, Jing
    Sun, Yu
    Wu, Fei
    Liu, Ziyue
    Zhai, Feifei
    Zhang, Yaoyun
    Somekh, Judith
    Peleg, Mor
    Zhu, Yi-Cheng
    Huang, Zhengxing
    ISCIENCE, 2024, 27 (07)
  • [45] Quantitative Longitudinal Predictions of Alzheimer's Disease by Multi-Modal Predictive Learning
    Prakash, Mithilesh
    Abdelaziz, Mahmoud
    Zhang, Linda
    Strange, Bryan A.
    Tohka, Jussi
    JOURNAL OF ALZHEIMERS DISEASE, 2021, 79 (04) : 1533 - 1546
  • [46] Multi-modal Graph Neural Network with Transformer-Guided Adaptive Diffusion for Preclinical Alzheimer Classification
    Sim, Jaeyoon
    Lee, Minjae
    Wu, Guorong
    Kim, Won Hwa
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT V, 2024, 15005 : 511 - 521
  • [47] Interoperable Multi-Modal Data Analysis Platform for Alzheimer's Disease Management
    Pang, Zhen
    Zhang, Shuhao
    Yang, Yun
    Qi, Jun
    Yang, Po
    2020 IEEE INTL SYMP ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, INTL CONF ON BIG DATA & CLOUD COMPUTING, INTL SYMP SOCIAL COMPUTING & NETWORKING, INTL CONF ON SUSTAINABLE COMPUTING & COMMUNICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2020), 2020, : 1321 - 1327
  • [48] BPGAN: Brain PET synthesis from MRI using generative adversarial network for multi-modal Alzheimer's disease diagnosis
    Zhang, Jin
    He, Xiaohai
    Qing, Linbo
    Gao, Feng
    Wang, Bin
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 217
  • [49] Disentangled Attention Graph Neural Network for Alzheimer's Disease Diagnosis
    Gamgam, Gurur
    Kabakcioglu, Alkan
    Dal, Demet Yuksel
    Acar, Burak
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT X, 2024, 15010 : 219 - 228
  • [50] ENHANCING ALZHEIMER'S DISEASE DIAGNOSIS VIA HIERARCHICAL 3D-FCN WITH MULTI-MODAL FEATURES
    Liu, Chao
    Yang, Xiaodong
    Chong, Dading
    Wang, Wenwu
    Li, Liang
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 304 - 308