MULTI-TASK DEEP LEARNING AND UNCERTAINTY ESTIMATION FOR PET HEAD MOTION CORRECTION

被引:0
|
作者
Lieffrig, Eleonore V. [1 ]
Zeng, Tianyi [1 ]
Zhang, Jiazhen [4 ]
Fontaine, Kathryn [1 ]
Fang, Xi [2 ]
Revilla, Enette [5 ]
Lu, Yihuan [6 ]
Onofrey, John A. [1 ,3 ,4 ]
机构
[1] Yale Univ, Dept Radiol & Biomed Imaging, New Haven, CT 06511 USA
[2] Yale Univ, Dept Psychiat, New Haven, CT USA
[3] Yale Univ, Dept Urol, New Haven, CT USA
[4] Yale Univ, Dept Biomed Engn, New Haven, CT USA
[5] Univ Calif Davis, Davis, CA USA
[6] United Imaging Healthcare, Shanghai, Peoples R China
基金
美国国家卫生研究院;
关键词
Multi-task Learning; Deep Learning; Motion Correction; Uncertainty Evaluation; PET; Brain; FDG-PET;
D O I
10.1109/ISBI53787.2023.10230791
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Head motion occurring during brain positron emission tomography images acquisition leads to a decrease in image quality and induces quantification errors. We have previously introduced a Deep Learning Head Motion Correction (DL-HMC) method based on supervised learning of gold-standard Polaris Vicra motion tracking device and showed the potential of this method. In this study, we upgrade our network to a multi-task architecture in order to include image appearance prediction in the learning process. This multi-task Deep Learning Head Motion Correction (mtDL-HMC) model was trained on 21 subjects and showed enhanced motion prediction performance compared to our previous DL-HMC method on both quantitative and qualitative results for 5 testing subjects. We also evaluate the trustworthiness of network predictions by performing Monte Carlo Dropout at inference on testing subjects. We discard the data associated with a great motion prediction uncertainty and show that this does not harm the quality of reconstructed images, and can even improve it.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] A Multi-Task Learning Framework for Head Pose Estimation under Target Motion
    Yan, Yan
    Ricci, Elisa
    Subramanian, Ramanathan
    Liu, Gaowen
    Lanz, Oswald
    Sebe, Nicu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (06) : 1070 - 1083
  • [2] Supervised Deep Learning for Head Motion Correction in PET
    Zeng, Tianyi
    Zhang, Jiazhen
    Revilla, Enette
    Lieffrig, Eleonore V.
    Fang, Xi
    Lu, Yihuan
    Onofrey, John A.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT IV, 2022, 13434 : 194 - 203
  • [3] PiCor: Multi-Task Deep Reinforcement Learning with Policy Correction
    Bai, Fengshuo
    Zhang, Hongming
    Tao, Tianyang
    Wu, Zhiheng
    Wang, Yanna
    Xu, Bo
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 6, 2023, : 6728 - 6736
  • [4] Uncertainty Regularized Multi-Task Learning
    Meshgi, Kourosh
    Mirzaei, Maryam Sadat
    Sekine, Satoshi
    PROCEEDINGS OF THE 12TH WORKSHOP ON COMPUTATIONAL APPROACHES TO SUBJECTIVITY, SENTIMENT & SOCIAL MEDIA ANALYSIS, 2022, : 78 - 88
  • [5] Fast Reconstruction for Deep Learning PET Head Motion Correction
    Zeng, Tianyi
    Zhang, Jiazhen
    Lieffrig, Eleonore V.
    Cai, Zhuotong
    Chen, Fuyao
    You, Chenyu
    Naganawa, Mika
    Lu, Yihuan
    Onofrey, John A.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 710 - 719
  • [6] Multi-Task Learning Framework for Motion Estimation and Dynamic Scene Deblurring
    Jung, Hyungjoo
    Kim, Youngjung
    Jang, Hyunsung
    Ha, Namkoo
    Sohn, Kwanghoon
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 8170 - 8183
  • [7] Pareto Multi-task Deep Learning
    Riccio, Salvatore D.
    Dyankov, Deyan
    Jansen, Giorgio
    Di Fatta, Giuseppe
    Nicosia, Giuseppe
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 132 - 141
  • [8] Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach
    Han, Hu
    Jain, Anil K.
    Wang, Fang
    Shan, Shiguang
    Chen, Xilin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) : 2597 - 2609
  • [9] Multi-Task Collaboration Deep Learning Framework for Infrared Precipitation Estimation
    Yang, Xuying
    Sun, Peng
    Zhang, Feng
    Du, Zhenhong
    Liu, Renyi
    REMOTE SENSING, 2021, 13 (12)
  • [10] Estimation of ground motion parameters via multi-task deep neural networks
    Fanchun Meng
    Tao Ren
    Enming Guo
    Hongfeng Chen
    Xinliang Liu
    Haodong Zhang
    Jiang Li
    Natural Hazards, 2024, 120 : 6737 - 6754