Alzheimer's disease diagnosis from multi-modal data via feature inductive learning and dual multilevel graph neural network

被引:3
|
作者
Lei, Baiying [1 ]
Li, Yafeng [1 ]
Fu, Wanyi [2 ]
Yang, Peng [1 ]
Chen, Shaobin [1 ]
Wang, Tianfu [1 ]
Xiao, Xiaohua [3 ]
Niu, Tianye [4 ]
Fu, Yu [5 ]
Wang, Shuqiang [6 ]
Han, Hongbin [7 ,8 ]
Qin, Jing [9 ]
机构
[1] Shenzhen Univ, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Marshall Lab Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound,Med, Shenzhen 518060, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing Key Lab Magnet Resonance Imaging Devices, Beijing, Peoples R China
[3] Shenzhen Univ, Med Sch, Affiliated Hosp 1, Shenzhen Peoples Hosp 2, Shenzhen 530031, Peoples R China
[4] Shenzhen Bay Lab, Shenzhen 518067, Peoples R China
[5] Peking Univ Third Hosp, Dept Neurol, 49 North Garden Rd, Beijing 100191, Peoples R China
[6] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[7] Peking Univ Third Hosp, Peking Univ Hlth Sci Ctr, Inst Med Technol, Dept Radiol,Beijing Key Lab Magnet Resonance Imag, Beijing 100191, Peoples R China
[8] Dalian Med Univ, Hosp 2, Res & Developing Ctr Med Technol, Dalian 116027, Peoples R China
[9] Hong Kong Polytech Univ, Ctr Smart Hlth, Sch Nursing, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 美国国家卫生研究院;
关键词
Alzheimer's disease analysis; Feature inductive learning; Dual multilevel graph neural network; Multi-modal data; CANONICAL CORRELATION-ANALYSIS; CONVOLUTIONAL NETWORK; CLASSIFICATION; ASSOCIATION; PREDICTION; VARIANTS;
D O I
10.1016/j.media.2024.103213
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi -modal data can provide complementary information of Alzheimer's disease (AD) and its development from different perspectives. Such information is closely related to the diagnosis, prevention, and treatment of AD, and hence it is necessary and critical to study AD through multi -modal data. Existing learning methods, however, usually ignore the influence of feature heterogeneity and directly fuse features in the last stages. Furthermore, most of these methods only focus on local fusion features or global fusion features, neglecting the complementariness of features at different levels and thus not sufficiently leveraging information embedded in multi -modal data. To overcome these shortcomings, we propose a novel framework for AD diagnosis that fuses gene, imaging, protein, and clinical data. Our framework learns feature representations under the same feature space for different modalities through a feature induction learning (FIL) module, thereby alleviating the impact of feature heterogeneity. Furthermore, in our framework, local and global salient multi -modal feature interaction information at different levels is extracted through a novel dual multilevel graph neural network (DMGNN). We extensively validate the proposed method on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and experimental results demonstrate our method consistently outperforms other state-of-the-art multi -modal fusion methods. The code is publicly available on the GitHub website. (https: //github.com/xiankantingqianxue/MIA-code.git)
引用
收藏
页数:15
相关论文
共 50 条
  • [31] MADP: Multi-modal Sequence Learning for Alzheimer's Disease Prediction with Missing Data
    Wang, Yudie
    Wang, Zirui
    Gong, Huiyun
    Wang, Sanwang
    Li, Mingzhe
    Dong, Jian
    GENERALIZING FROM LIMITED RESOURCES IN THE OPEN WORLD, GLOW-IJCAI 2024, 2024, 2160 : 93 - 103
  • [32] MMTFN: Multi-modal multi-scale transformer fusion network for Alzheimer's disease diagnosis
    Miao, Shang
    Xu, Qun
    Li, Weimin
    Yang, Chao
    Sheng, Bin
    Liu, Fangyu
    Bezabih, Tsigabu T.
    Yu, Xiao
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [33] A Multi-Modal Hypergraph Neural Network via Parametric Filtering and Feature Sampling
    Liu, Zijian
    Luo, Yang
    Pu, Xitong
    Min, Geyong
    Luo, Chunbo
    IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (05) : 1365 - 1379
  • [34] Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer’s disease
    Meie Fang
    Zhuxin Jin
    Feiwei Qin
    Yong Peng
    Chao Jiang
    Zhigeng Pan
    Multimedia Tools and Applications, 2022, 81 : 29159 - 29175
  • [35] Re-transfer learning and multi-modal learning assisted early diagnosis of Alzheimer's disease
    Fang, Meie
    Jin, Zhuxin
    Qin, Feiwei
    Peng, Yong
    Jiang, Chao
    Pan, Zhigeng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 29159 - 29175
  • [36] Relation-Induced Multi-Modal Shared Representation Learning for Alzheimer's Disease Diagnosis
    Ning, Zhenyuan
    Xiao, Qing
    Feng, Qianjin
    Chen, Wufan
    Zhang, Yu
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (06) : 1632 - 1645
  • [37] Multi-modal classification of Alzheimer's disease using nonlinear graph fusion
    Tong, Tong
    Gray, Katherine
    Gao, Qinquan
    Chen, Liang
    Rueckert, Daniel
    PATTERN RECOGNITION, 2017, 63 : 171 - 181
  • [38] Longitudinal and Multi-modal Data Learning via Joint Embedding and Sparse Regression for Parkinson's Disease Diagnosis
    Lei, Haijun
    Huang, Zhongwei
    Elazab, Ahmed
    Li, Hancong
    Lei, Baiying
    MACHINE LEARNING IN MEDICAL IMAGING: 9TH INTERNATIONAL WORKSHOP, MLMI 2018, 2018, 11046 : 310 - 318
  • [39] Integrating Transfer Learning and Deep Neural Networks for Accurate Medical Disease Diagnosis from Multi-Modal Data
    Kaur, Chamandeep
    Al-Ansari, Abdul Rahman Mohammed
    Gongada, Taviti Naidu
    Saravanan, K. Aanandha
    Rao, Divvela Srinivasa
    Borda, Ricardo Fernando Cosio
    Manikandan, R.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (08) : 518 - 528
  • [40] Interactive Learning of a Dual Convolution Neural Network for Multi-Modal Action Recognition
    Li, Qingxia
    Gao, Dali
    Zhang, Qieshi
    Wei, Wenhong
    Ren, Ziliang
    MATHEMATICS, 2022, 10 (21)