Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach

被引:3
|
作者
Li, Ji [1 ,2 ]
Wang, Weixi [1 ]
Ji, Hui [1 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore, Singapore
[2] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing, Peoples R China
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 04期
关键词
self-supervised learning; inverse problems; image reconstruction; Langevin dynamics; Bayesian inference; PLAY PRIORS; PLUG; RESTORATION; CONVERGENCE;
D O I
10.1137/23M1548025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has proved to be a powerful tool for solving inverse problems in imaging, and most of the related work is based on supervised learning. In many applications, collecting truth images is a challenging and costly task, and the prerequisite of having a training dataset of truth images limits its applicability. This paper proposes a self-supervised deep learning method for solving inverse imaging problems that does not require any training samples. The proposed approach is built on a reparametrization of latent images using a convolutional neural network, and the reconstruction is motivated by approximating the minimum mean square error estimate of the latent image using a Langevin dynamics-based Monte Carlo (MC) method. To efficiently sample the network weights in the context of image reconstruction, we propose a Langevin MC scheme called Adam-LD, inspired by the well-known optimizer in deep learning, Adam. The proposed method is applied to solve linear and nonlinear inverse problems, specifically, sparse-view computed tomography image reconstruction and phase retrieval. Our experiments demonstrate that the proposed method outperforms existing unsupervised or self-supervised solutions in terms of reconstruction quality.
引用
收藏
页码:2247 / 2284
页数:38
相关论文
共 50 条
  • [21] DEEP SELF-SUPERVISED LEARNING FOR FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION
    Li, Yu
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 501 - 504
  • [22] Self-Supervised Deep Learning for Low-Dose CT Image Denoising
    Bai, T.
    Nguyen, D.
    Jiang, S.
    MEDICAL PHYSICS, 2020, 47 (06) : E658 - E658
  • [23] Hyperspectral image super resolution using deep internal and self-supervised learning
    Liu, Zhe
    Han, Xian-Hua
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024, 9 (01) : 128 - 141
  • [24] Self-Supervised Blind Image Deconvolution via Deep Generative Ensemble Learning
    Chen, Mingqin
    Quan, Yuhui
    Xu, Yong
    Ji, Hui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 634 - 647
  • [25] Self-Supervised Deep Fisheye Image Rectification Approach using Coordinate Relations
    Hosono, Masaki
    Simo-Serra, Edgar
    Sonoda, Tomonari
    PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [26] A General Framework for Inverse Problem Solving using Self-Supervised Deep Learning Validations in Ultrasound and Photoacoustic Image Reconstruction
    Zhang, Jingke
    He, Qiong
    Wang, Congzhi
    Liao, Hongen
    Luo, Jianwen
    INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS 2021), 2021,
  • [27] SELF-SUPERVISED LEARNING FOR STEREO RECONSTRUCTION ON AERIAL IMAGES
    Knoebelreiter, Patrick
    Vogel, Christoph
    Pock, Thomas
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 4379 - 4382
  • [28] Self-Supervised Learning for Seismic Data Reconstruction and Denoising
    Meng, Fanlei
    Fan, QinYin
    Li, Yue
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [29] Sybil Attack Identification for Crowdsourced Navigation: A Self-Supervised Deep Learning Approach
    Yu, James J. Q.
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (07) : 4622 - 4634
  • [30] Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting
    Cho, Donghyeon
    Park, Jinsun
    Oh, Tae-Hyun
    Tai, Yu-Wing
    Kweon, In So
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4568 - 4577