MULTI-TASK DEEP LEARNING AND UNCERTAINTY ESTIMATION FOR PET HEAD MOTION CORRECTION

被引:0
|
作者
Lieffrig, Eleonore V. [1 ]
Zeng, Tianyi [1 ]
Zhang, Jiazhen [4 ]
Fontaine, Kathryn [1 ]
Fang, Xi [2 ]
Revilla, Enette [5 ]
Lu, Yihuan [6 ]
Onofrey, John A. [1 ,3 ,4 ]
机构
[1] Yale Univ, Dept Radiol & Biomed Imaging, New Haven, CT 06511 USA
[2] Yale Univ, Dept Psychiat, New Haven, CT USA
[3] Yale Univ, Dept Urol, New Haven, CT USA
[4] Yale Univ, Dept Biomed Engn, New Haven, CT USA
[5] Univ Calif Davis, Davis, CA USA
[6] United Imaging Healthcare, Shanghai, Peoples R China
基金
美国国家卫生研究院;
关键词
Multi-task Learning; Deep Learning; Motion Correction; Uncertainty Evaluation; PET; Brain; FDG-PET;
D O I
10.1109/ISBI53787.2023.10230791
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Head motion occurring during brain positron emission tomography images acquisition leads to a decrease in image quality and induces quantification errors. We have previously introduced a Deep Learning Head Motion Correction (DL-HMC) method based on supervised learning of gold-standard Polaris Vicra motion tracking device and showed the potential of this method. In this study, we upgrade our network to a multi-task architecture in order to include image appearance prediction in the learning process. This multi-task Deep Learning Head Motion Correction (mtDL-HMC) model was trained on 21 subjects and showed enhanced motion prediction performance compared to our previous DL-HMC method on both quantitative and qualitative results for 5 testing subjects. We also evaluate the trustworthiness of network predictions by performing Monte Carlo Dropout at inference on testing subjects. We discard the data associated with a great motion prediction uncertainty and show that this does not harm the quality of reconstructed images, and can even improve it.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Multi-Task Head Pose Estimation in-the-Wild
    Valle, Roberto
    Buenaposada, Jose M.
    Baumela, Luis
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) : 2874 - 2881
  • [22] A Multi-task Learning Framework for Quality Estimation
    Deoghare, Sourabh
    Choudhary, Paramveer
    Kanojia, Diptesh
    Ranasinghe, Tharindu
    Bhattacharyya, Pushpak
    Orasan, Constantin
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 9191 - 9205
  • [23] Cancer Classification with Multi-task Deep Learning
    Liao, Qing
    Jiang, Lin
    Wang, Xuan
    Zhang, Chunkai
    Ding, Ye
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 76 - 81
  • [24] Deep Learning for Multi-task Plant Phenotyping
    Pound, Michael P.
    Atkinson, Jonathan A.
    Wells, Darren M.
    Pridmore, Tony P.
    French, Andrew P.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2055 - 2063
  • [25] Multi-Task Deep Learning Seismic Impedance Inversion Optimization Based on Homoscedastic Uncertainty
    Zheng, Xiu
    Wu, Bangyu
    Zhu, Xiaosan
    Zhu, Xu
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [26] Multi-task Deep Learning for Image Understanding
    Yu, Bo
    Lane, Ian
    2014 6TH INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION (SOCPAR), 2014, : 37 - 42
  • [27] Deep Asymmetric Multi-task Feature Learning
    Lee, Hae Beom
    Yang, Eunho
    Hwang, Sung Ju
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [28] Multi-Task Learning for Influence Estimation and Maximization
    Panagopoulos, George
    Malliaros, Fragkiskos D.
    Vazirgiannis, Michalis
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (09) : 4398 - 4409
  • [29] MULTI-TASK DEEP LEARNING SEISMIC IMPEDANCE INVERSION OPTIMIZATION BASED ON HOMOSCEDASTIC UNCERTAINTY
    Zheng, Xiu
    Wu, Bangyu
    Zhu, Xu
    Zhu, Xiaosan
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 6149 - 6152
  • [30] Region Attentive Action Unit Intensity Estimation With Uncertainty Weighted Multi-Task Learning
    Chen, Haifeng
    Jiang, Dongmei
    Zhao, Yong
    Wei, Xiaoyong
    Lu, Ke
    Sahli, Hichem
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2033 - 2047