Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach

被引:3
|
作者
Li, Ji [1 ,2 ]
Wang, Weixi [1 ]
Ji, Hui [1 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore, Singapore
[2] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing, Peoples R China
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 04期
关键词
self-supervised learning; inverse problems; image reconstruction; Langevin dynamics; Bayesian inference; PLAY PRIORS; PLUG; RESTORATION; CONVERGENCE;
D O I
10.1137/23M1548025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has proved to be a powerful tool for solving inverse problems in imaging, and most of the related work is based on supervised learning. In many applications, collecting truth images is a challenging and costly task, and the prerequisite of having a training dataset of truth images limits its applicability. This paper proposes a self-supervised deep learning method for solving inverse imaging problems that does not require any training samples. The proposed approach is built on a reparametrization of latent images using a convolutional neural network, and the reconstruction is motivated by approximating the minimum mean square error estimate of the latent image using a Langevin dynamics-based Monte Carlo (MC) method. To efficiently sample the network weights in the context of image reconstruction, we propose a Langevin MC scheme called Adam-LD, inspired by the well-known optimizer in deep learning, Adam. The proposed method is applied to solve linear and nonlinear inverse problems, specifically, sparse-view computed tomography image reconstruction and phase retrieval. Our experiments demonstrate that the proposed method outperforms existing unsupervised or self-supervised solutions in terms of reconstruction quality.
引用
收藏
页码:2247 / 2284
页数:38
相关论文
共 50 条
  • [31] Deep self-supervised transformation learning for leukocyte classification
    Chen, Xinwei
    Zheng, Guolin
    Zhou, Liwei
    Li, Zuoyong
    Fan, Haoyi
    JOURNAL OF BIOPHOTONICS, 2023, 16 (03)
  • [32] Self-Supervised Synthesis Ranking for Deep Metric Learning
    Fu, Zheren
    Mao, Zhendong
    Yan, Chenggang
    Liu, An-An
    Xie, Hongtao
    Zhang, Yongdong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4736 - 4750
  • [33] Self-supervised Learning for Anomaly Detection in Fundus Image
    Ahn, Sangil
    Shin, Jitae
    OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022, 2022, 13576 : 143 - 151
  • [34] Image denoising for fluorescence microscopy by supervised to self-supervised transfer learning
    Wang, Yina
    Pinkard, Henry
    Khwaja, Emaad
    Zhou, Shuqin
    Waller, Laura
    Huang, Bo
    OPTICS EXPRESS, 2021, 29 (25) : 41303 - 41312
  • [35] Weather Recognition Using Self-supervised Deep Learning
    Acuna-Escobar, Diego
    Intriago-Pazmino, Monserrate
    Ibarra-Fiallo, Julio
    SMART TECHNOLOGIES, SYSTEMS AND APPLICATIONS, SMARTTECH-IC 2021, 2022, 1532 : 161 - 174
  • [36] Self-Supervised Deep Learning-The Next Frontier
    Liu, T. Y. Alvin
    Koseoglu, Neslihan Dilruba
    Jones, Craig
    JAMA OPHTHALMOLOGY, 2024, 142 (03) : 234 - 234
  • [37] A Deep Cut Into Split Federated Self-Supervised Learning
    Przewiezlikowski, Marcin
    Osial, Marcin
    Zielinski, Bartosz
    Smieja, Marek
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT II, ECML PKDD 2024, 2024, 14942 : 444 - 459
  • [38] Deep Bregman divergence for self-supervised representations learning
    Rezaei, Mina
    Soleymani, Farzin
    Bischl, Bernd
    Azizi, Shekoofeh
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [39] Directional Self-supervised Learning for Heavy Image Augmentations
    Bai, Yalong
    Yang, Yifan
    Zhang, Wei
    Mei, Tao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16671 - 16680
  • [40] Text-to-image synthesis with self-supervised learning
    Tan, Yong Xuan
    Lee, Chin Poo
    Neo, Mai
    Lim, Kian Ming
    PATTERN RECOGNITION LETTERS, 2022, 157 : 119 - 126