Stable Deep MRI Reconstruction Using Generative Priors

被引:3
|
作者
Zach, Martin [1 ]
Knoll, Florian [2 ]
Pock, Thomas [1 ]
机构
[1] Graz Univ Technol, Inst Comp Graph & Vis, A-8010 Graz, Austria
[2] Friedrich Alexander Univ Erlangen Nuernberg, Dept Artificial Intelligence Biomed Engn, D-91052 Erlangen, Germany
关键词
MRI; generative priors; stable inverse prob-lems; IMAGE-RECONSTRUCTION; SENSE; FRAMEWORK; LANGEVIN; EXPERTS; FIELDS;
D O I
10.1109/TMI.2023.3311345
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper, we address these challenges in a unified framework based on generative image priors. We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. After training, the regularizer encodes higher-level domain statistics which we demonstrate by synthesizing images without data. Embedding the trained model in a classical variational approach yields high-quality reconstructions irrespective of the sub-sampling pattern. In addition, the model shows stable behavior when confronted with out-of-distribution data in the form of contrast variation. Furthermore, a probabilistic interpretation provides a distribution of reconstructions and hence allows uncertainty quantification. To reconstruct parallel MRI, we propose a fast algorithm to jointly estimate the image and the sensitivity maps. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods, while preserving the flexibility with respect to sub-sampling patterns and allowing for uncertainty quantification.
引用
收藏
页码:3817 / 3832
页数:16
相关论文
共 50 条
  • [41] Segmentation of MRI head anatomy using deep volumetric networks and multiple spatial priors
    Hirsch, Lukas
    Huang, Yu
    Parra, Lucas C.
    JOURNAL OF MEDICAL IMAGING, 2021, 8 (03)
  • [42] Structure Preserving Compressive Sensing MRI Reconstruction using Generative Adversarial Networks
    Deora, Puneesh
    Vasudeva, Bhavya
    Bhattacharya, Saumik
    Pradhan, Pyari Mohan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2211 - 2219
  • [43] Reconstruction of Compressed Sensing MRI: An Experimental Review among Priors- and Deep Learning- based Algorithms
    Islam, Rafiqul
    2020 2ND INTERNATIONAL CONFERENCE ON SUSTAINABLE TECHNOLOGIES FOR INDUSTRY 4.0 (STI), 2020,
  • [44] PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors
    Kim, Jaeyeon
    Hua, Binh-Son
    Nguyen, Duc Thanh
    Yeung, Sai-Kit
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 592 - 601
  • [45] Robust Reconstruction of MRSI Data Using a Sparse Spectral Model and High Resolution MRI Priors
    Eslami, Ramin
    Jacob, Mathews
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (06) : 1297 - 1309
  • [46] Bayesian sparse regularization for parallel MRI reconstruction using complex Bernoulli–Laplace mixture priors
    Siwar Chaabene
    Lotfi Chaari
    Abdelaziz Kallel
    Signal, Image and Video Processing, 2020, 14 : 445 - 453
  • [47] Deep HDR estimation with generative detail reconstruction
    Zhang, Y.
    Aydin, T. O.
    COMPUTER GRAPHICS FORUM, 2021, 40 (02) : 179 - 190
  • [48] Virtual tissue microstructure reconstruction across species using generative deep learning
    Bettancourt, Nicolas
    Perez-Gallardo, Cristian
    Candia, Valeria
    Guevara, Pamela
    Kalaidzidis, Yannis
    Zerial, Marino
    Segovia-Miranda, Fabian
    Morales-Navarrete, Hernan
    PLOS ONE, 2024, 19 (07):
  • [49] The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
    Prokopenko, Denis
    Hammernik, Kerstin
    Roberts, Thomas
    Lloyd, David F. A.
    Rueckert, Daniel
    Hajnal, Joseph V.
    PERINATAL, PRETERM AND PAEDIATRIC IMAGE ANALYSIS, PIPPI 2023, 2023, 14246 : 64 - 74
  • [50] Deep Generative Model for Spatial-Spectral Unmixing With Multiple Endmember Priors
    Shi, Shuaikai
    Zhang, Lijun
    Altmann, Yoann
    Chen, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60