Disentangle First, Then Distill: A Unified Framework for Missing Modality Imputation and Alzheimer's Disease Diagnosis

被引:7
|
作者
Chen, Yuanyuan [1 ]
Pan, Yongsheng [2 ]
Xia, Yong [1 ]
Yuan, Yixuan [3 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[2] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[3] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
关键词
Alzheimer's disease; mild cognitive impairment; multi-modality diagnosis; modality imputation; BRAIN-TUMOR SEGMENTATION; REPRESENTATION; NETWORK;
D O I
10.1109/TMI.2023.3295489
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multi-modality medical data provide complementary information, and hence have been widely explored for computer-aided AD diagnosis. However, the research is hindered by the unavoidable missing-data problem, i.e., one data modality was not acquired on some subjects due to various reasons. Although the missing data can be imputed using generative models, the imputation process may introduce unrealistic information to the classification process, leading to poor performance. In this paper, we propose the Disentangle First, Then Distill (DFTD) framework for AD diagnosis using incomplete multi-modality medical images. First, we design a region-aware disentanglement module to disentangle each image into inter-modality relevant representation and intra-modality specific representation with emphasis on disease-related regions. To progressively integrate multi-modality knowledge, we then construct an imputation-induced distillation module, in which a lateral inter-modality transition unit is created to impute representation of the missing modality. The proposed DFTD framework has been evaluated against six existing methods on an ADNI dataset with 1248 subjects. The results show that our method has superior performance in both AD-CN classification and MCI-to-AD prediction tasks, substantially over-performing all competing methods.
引用
收藏
页码:3566 / 3578
页数:13
相关论文
共 50 条
  • [31] MoRA: LoRA Guided Multi-modal Disease Diagnosis with Missing Modality
    Shi, Zhiyi
    Kim, Junsik
    Li, Wanhua
    Li, Yicong
    Pfister, Hanspeter
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT III, 2024, 15003 : 273 - 282
  • [32] Prototype-based sample-weighted distillation unified framework adapted to missing modality sentiment analysis
    Zhang, Yujuan
    Liu, Fangai
    Zhuang, Xuqiang
    Hou, Ying
    Zhang, Yuling
    NEURAL NETWORKS, 2024, 177
  • [33] INTERPRETABLE GRAPH CONVOLUTIONAL NETWORK OF MULTI-MODALITY BRAIN IMAGING FOR ALZHEIMER'S DISEASE DIAGNOSIS
    Zhou, Houliang
    He, Lifang
    Zhang, Yu
    Shen, Li
    Chen, Brian
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [34] Unified AI framework to uncover deep interrelationships between gene expression and Alzheimer’s disease neuropathologies
    Nicasia Beebe-Wang
    Safiye Celik
    Ethan Weinberger
    Pascal Sturmfels
    Philip L. De Jager
    Sara Mostafavi
    Su-In Lee
    Nature Communications, 12
  • [35] Unified AI framework to uncover deep interrelationships between gene expression and Alzheimer's disease neuropathologies
    Beebe-Wang, Nicasia
    Celik, Safiye
    Weinberger, Ethan
    Sturmfels, Pascal
    De Jager, Philip L.
    Mostafavi, Sara
    Lee, Su-In
    NATURE COMMUNICATIONS, 2021, 12 (01)
  • [36] Improving Regression Analysis with Imputation in a Longitudinal Study of Alzheimer's Disease
    Chandrasekaran, Ganesh
    Xie, Sharon X.
    JOURNAL OF ALZHEIMERS DISEASE, 2024, 99 (01) : 263 - 277
  • [37] Biomarkers for Alzheimer's Disease Diagnosis
    Mantzavinos, Vasileios
    Alexiou, Athanasios
    CURRENT ALZHEIMER RESEARCH, 2017, 14 (11) : 1149 - 1154
  • [38] Alzheimer's disease diagnosis in the metaverse
    Bazargani, Jalal Safari
    Rahim, Nasir
    Sadeghi-Niaraki, Abolghasem
    Abuhmed, Tamer
    Song, Houbing
    Choi, Soo-Mi
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2024, 255
  • [39] The neuropsychological diagnosis of Alzheimer's disease
    Storey, Elsdon
    Kinsella, Glynda J.
    Slavin, Melissa J.
    JOURNAL OF ALZHEIMERS DISEASE, 2001, 3 (03) : 261 - 285
  • [40] Early Diagnosis of Alzheimer's Disease
    Ames, David
    AUSTRALASIAN JOURNAL ON AGEING, 2001, 20 (04) : 210 - 211