MULTI-TASK DEEP LEARNING AND UNCERTAINTY ESTIMATION FOR PET HEAD MOTION CORRECTION

被引:0
|
作者
Lieffrig, Eleonore V. [1 ]
Zeng, Tianyi [1 ]
Zhang, Jiazhen [4 ]
Fontaine, Kathryn [1 ]
Fang, Xi [2 ]
Revilla, Enette [5 ]
Lu, Yihuan [6 ]
Onofrey, John A. [1 ,3 ,4 ]
机构
[1] Yale Univ, Dept Radiol & Biomed Imaging, New Haven, CT 06511 USA
[2] Yale Univ, Dept Psychiat, New Haven, CT USA
[3] Yale Univ, Dept Urol, New Haven, CT USA
[4] Yale Univ, Dept Biomed Engn, New Haven, CT USA
[5] Univ Calif Davis, Davis, CA USA
[6] United Imaging Healthcare, Shanghai, Peoples R China
基金
美国国家卫生研究院;
关键词
Multi-task Learning; Deep Learning; Motion Correction; Uncertainty Evaluation; PET; Brain; FDG-PET;
D O I
10.1109/ISBI53787.2023.10230791
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Head motion occurring during brain positron emission tomography images acquisition leads to a decrease in image quality and induces quantification errors. We have previously introduced a Deep Learning Head Motion Correction (DL-HMC) method based on supervised learning of gold-standard Polaris Vicra motion tracking device and showed the potential of this method. In this study, we upgrade our network to a multi-task architecture in order to include image appearance prediction in the learning process. This multi-task Deep Learning Head Motion Correction (mtDL-HMC) model was trained on 21 subjects and showed enhanced motion prediction performance compared to our previous DL-HMC method on both quantitative and qualitative results for 5 testing subjects. We also evaluate the trustworthiness of network predictions by performing Monte Carlo Dropout at inference on testing subjects. We discard the data associated with a great motion prediction uncertainty and show that this does not harm the quality of reconstructed images, and can even improve it.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Heterogeneous Multi-task Learning for Human Pose Estimation with Deep Convolutional Neural Network
    Li, Sijin
    Liu, Zhi-Qiang
    Chan, Antoni B.
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) : 19 - 36
  • [42] TRIPLET-UNCERTAINTY IN MULTI-TASK DEEP LEARNING FOR IMPROVING MALIGNANCY CHARACTERIZATION OF HEPATOCELLULAR CARCINOMA
    Xie, Yanyan
    Li, Shangxuan
    Li, Xian
    Liu, Baoer
    Xu, Yikai
    Zhou, Wu
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [43] Deep Multi-task Learning for Animal Chest Circumference Estimation from Monocular Images
    Zhang, Hongtao
    Gu, Dongbing
    COGNITIVE COMPUTATION, 2024, 16 (03) : 1092 - 1102
  • [44] Deep Multi-Task Learning-Based Simultaneous Channel Tap and Coefficient Estimation
    Aygul, Mehmet Ali
    Cirpan, Hakan Ali
    Arslan, Huseyin
    2023 IEEE FUTURE NETWORKS WORLD FORUM, FNWF, 2024,
  • [45] Heterogeneous Multi-task Learning for Human Pose Estimation with Deep Convolutional Neural Network
    Sijin Li
    Zhi-Qiang Liu
    Antoni B. Chan
    International Journal of Computer Vision, 2015, 113 : 19 - 36
  • [46] Multi-task Deep Learning for Colon Cancer Grading
    Thi Le Trinh Vuong
    Lee, Daigeun
    Kwak, Jin Tae
    Kim, Kyungeun
    2020 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2020,
  • [47] Saliency-Regularized Deep Multi-Task Learning
    Bai, Guangji
    Zhao, Liang
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 15 - 25
  • [48] Unsupervised learning of multi-task deep variational model
    Tan, Lu
    Li, Ling
    Liu, Wan-Quan
    An, Sen-Jian
    Munyard, Kylie
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
  • [49] MULTI-TASK LEARNING FOR FACE IDENTIFICATION AND ATTRIBUTE ESTIMATION
    Hsieh, Hui-Lan
    Hsu, Winston
    Chen, Yan-Ying
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2981 - 2985
  • [50] Multi-task Representation Learning for Travel Time Estimation
    Li, Yaguang
    Fu, Kun
    Wang, Zheng
    Shahabi, Cyrus
    Ye, Jieping
    Liu, Yan
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1695 - 1704