Disentangle First, Then Distill: A Unified Framework for Missing Modality Imputation and Alzheimer's Disease Diagnosis

被引:7
|
作者
Chen, Yuanyuan [1 ]
Pan, Yongsheng [2 ]
Xia, Yong [1 ]
Yuan, Yixuan [3 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci & Engn, Natl Engn Lab Integrated Aerosp Ground Ocean Big D, Xian 710072, Peoples R China
[2] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[3] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
关键词
Alzheimer's disease; mild cognitive impairment; multi-modality diagnosis; modality imputation; BRAIN-TUMOR SEGMENTATION; REPRESENTATION; NETWORK;
D O I
10.1109/TMI.2023.3295489
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multi-modality medical data provide complementary information, and hence have been widely explored for computer-aided AD diagnosis. However, the research is hindered by the unavoidable missing-data problem, i.e., one data modality was not acquired on some subjects due to various reasons. Although the missing data can be imputed using generative models, the imputation process may introduce unrealistic information to the classification process, leading to poor performance. In this paper, we propose the Disentangle First, Then Distill (DFTD) framework for AD diagnosis using incomplete multi-modality medical images. First, we design a region-aware disentanglement module to disentangle each image into inter-modality relevant representation and intra-modality specific representation with emphasis on disease-related regions. To progressively integrate multi-modality knowledge, we then construct an imputation-induced distillation module, in which a lateral inter-modality transition unit is created to impute representation of the missing modality. The proposed DFTD framework has been evaluated against six existing methods on an ADNI dataset with 1248 subjects. The results show that our method has superior performance in both AD-CN classification and MCI-to-AD prediction tasks, substantially over-performing all competing methods.
引用
收藏
页码:3566 / 3578
页数:13
相关论文
共 50 条
  • [1] Disentangle Then Calibrate With Gradient Guidance: A Unified Framework for Common and Rare Disease Diagnosis
    Chen, Yuanyuan
    Guo, Xiaoqing
    Xia, Yong
    Yuan, Yixuan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (05) : 1816 - 1827
  • [2] Unified Multi-Modal Image Synthesis for Missing Modality Imputation
    Zhang, Yue
    Peng, Chengtao
    Wang, Qiuli
    Song, Dan
    Li, Kaiyan
    Zhou, S. Kevin
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2025, 44 (01) : 4 - 18
  • [3] Towards Unified Modality Understanding for Alzheimer's Disease Diagnosis Using Incomplete Multi-modality Data
    Han, Kangfu
    Zhao, Fenqiang
    Zhu, Dajiang
    Liu, Tianming
    Yang, Feng
    Li, Gang
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT II, 2024, 14349 : 184 - 193
  • [4] Unified Multi-modal Learning for Any Modality Combinations in Alzheimer's Disease Diagnosis
    Feng, Yidan
    Gao, Bingchen
    Deng, Sen
    Qiu, Anqi
    Qin, Jing
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT III, 2024, 15003 : 487 - 497
  • [5] Autoencoder imputation of missing heterogeneous data for Alzheimer's disease classification
    Haridas, Namitha Thalekkara
    Sanchez-Bornot, Jose M.
    McClean, Paula L.
    Wong-Lin, KongFatt
    HEALTHCARE TECHNOLOGY LETTERS, 2024, 11 (06) : 452 - 460
  • [6] A Modality-Flexible Framework for Alzheimer's Disease Diagnosis Following Clinical Routine
    Zhang, Yuanwang
    Sun, Kaicong
    Liu, Yuxiao
    Xie, Fang
    Guo, Qihao
    Shen, Dinggang
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2025, 29 (01) : 535 - 546
  • [7] Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction
    Xu, Yi
    Bazarjani, Armin
    Chi, Hyung-gun
    Choi, Chiho
    Fu, Yun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9632 - 9643
  • [8] An Optimal Framework for Alzheimer's Disease Diagnosis
    Alsaraira, Amer
    Alabed, Samer
    Hamad, Eyad
    Saraereh, Omar
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 37 (01): : 165 - 177
  • [9] A new framework for the diagnosis of Alzheimer's disease
    Foster, Norman L.
    LANCET NEUROLOGY, 2007, 6 (08): : 667 - 669
  • [10] Diagnosis of Alzheimer's disease with Electroencephalography in a differential framework
    Houmani, Nesma
    Vialatte, Francois
    Gallego-Jutgla, Esteve
    Dreyfus, Gerard
    Nguyen-Michels, Vi-Huong
    Mariani, Jean
    Kinugawa, Kiyoka
    PLOS ONE, 2018, 13 (03):