End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network

被引:21
|
作者
Lian, Chunfeng
Liu, Mingxia [1 ]
Wang, Li
Shen, Dinggang [1 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27599 USA
关键词
DISEASE;
D O I
10.1007/978-3-030-32251-9_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computer-aided prediction of dementia status (e.g., clinical scores of cognitive tests) from brain MRI is of great clinical value, as it can help assess pathological stage and predict disease progression. Existing learning-based approaches typically preselect dementia-sensitive regions from the whole-brain MRI for feature extraction and prediction model construction, which might be sub-optimal due to potential heterogeneities between different steps. Also, based on anatomical prior knowledge (e.g., brain atlas) and time-consuming nonlinear registration, these preselected brain regions are usually the same across all subjects, ignoring their individual specificities in dementia progression. In this paper, we propose a multi-task weakly-supervised attention network (MWAN) to jointly predict multiple clinical scores from the baseline MRI data, by explicitly considering individual specificities of different subjects. Leveraging a fully-trainable dementia attention block, our MWAN method can automatically identify subject-specific discriminative locations from the whole-brain MRI for end-to-end feature learning and multi-task regression. We evaluated our MWAN method by cross-validation on two public datasets (i.e., ADNI-1 and ADNI-2). Experimental results demonstrate that the proposed method performs well in both the tasks of clinical score prediction and weakly-supervised discriminative localization in brain MR images.
引用
收藏
页码:158 / 167
页数:10
相关论文
共 50 条
  • [1] Multi-Task Weakly-Supervised Attention Network for Dementia Status Estimation With Structural MRI
    Lian, Chunfeng
    Liu, Mingxia
    Wang, Li
    Shen, Dinggang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 4056 - 4068
  • [2] End-to-End Multi-Task Learning with Attention
    Liu, Shikun
    Johns, Edward
    Davison, Andrew J.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1871 - 1880
  • [3] Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformers
    Ru, Lixiang
    Zhan, Yibing
    Yu, Baosheng
    Du, Bo
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16825 - 16834
  • [4] SDAPNet: End-to-End Multi-task Simultaneous Detection and Prediction Network
    Ye, Shanding
    Yao, Han
    Wang, Wenfu
    Fu, Yongjian
    Pan, Zhijie
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [5] ATTENTION-AUGMENTED END-TO-END MULTI-TASK LEARNING FOR EMOTION PREDICTION FROM SPEECH
    Zhang, Zixing
    Wu, Bingwen
    Schuller, Bjoern
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6705 - 6709
  • [6] Multi-task Learning with Attention for End-to-end Autonomous Driving
    Ishihara, Keishi
    Kanervisto, Anssi
    Miura, Jun
    Hautamaki, Ville
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2896 - 2905
  • [7] Local optimization cropping and boundary enhancement for end-to-end weakly-supervised segmentation network
    Wang, Weizheng
    Zeng, Chao
    Wang, Haonan
    Zhou, Lei
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2025, 251
  • [8] Towards Weakly-Supervised Text Spotting using a Multi-Task Transformer
    Kittenplon, Yair
    Lavi, Inbal
    Fogel, Sharon
    Bar, Yarin
    Manmatha, R.
    Perona, Pietro
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4594 - 4603
  • [9] End-to-End Multi-task Learning Architecture for Brain Tumor Analysis with Uncertainty Estimation in MRI Images
    Nazir, Maria
    Shakil, Sadia
    Khurshid, Khurram
    JOURNAL OF IMAGING INFORMATICS IN MEDICINE, 2024, 37 (05): : 2149 - 2172
  • [10] JOINT CTC-ATTENTION BASED END-TO-END SPEECH RECOGNITION USING MULTI-TASK LEARNING
    Kim, Suyoun
    Hori, Takaaki
    Watanabe, Shinji
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 4835 - 4839