Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach

被引:3
|
作者
Li, Ji [1 ,2 ]
Wang, Weixi [1 ]
Ji, Hui [1 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore, Singapore
[2] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing, Peoples R China
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 04期
关键词
self-supervised learning; inverse problems; image reconstruction; Langevin dynamics; Bayesian inference; PLAY PRIORS; PLUG; RESTORATION; CONVERGENCE;
D O I
10.1137/23M1548025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has proved to be a powerful tool for solving inverse problems in imaging, and most of the related work is based on supervised learning. In many applications, collecting truth images is a challenging and costly task, and the prerequisite of having a training dataset of truth images limits its applicability. This paper proposes a self-supervised deep learning method for solving inverse imaging problems that does not require any training samples. The proposed approach is built on a reparametrization of latent images using a convolutional neural network, and the reconstruction is motivated by approximating the minimum mean square error estimate of the latent image using a Langevin dynamics-based Monte Carlo (MC) method. To efficiently sample the network weights in the context of image reconstruction, we propose a Langevin MC scheme called Adam-LD, inspired by the well-known optimizer in deep learning, Adam. The proposed method is applied to solve linear and nonlinear inverse problems, specifically, sparse-view computed tomography image reconstruction and phase retrieval. Our experiments demonstrate that the proposed method outperforms existing unsupervised or self-supervised solutions in terms of reconstruction quality.
引用
收藏
页码:2247 / 2284
页数:38
相关论文
共 50 条
  • [41] Multimodal Self-supervised Learning for Medical Image Analysis
    Taleb, Aiham
    Lippert, Christoph
    Klein, Tassilo
    Nabi, Moin
    INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2021, 2021, 12729 : 661 - 673
  • [42] IMAGE ENHANCED ROTATION PREDICTION FOR SELF-SUPERVISED LEARNING
    Yamaguchi, Shinya
    Kanai, Sekitoshi
    Shioda, Tetsuya
    Takeda, Shoichiro
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 489 - 493
  • [43] Self-Supervised Joint Learning for pCLE Image Denoising
    Yang, Kun
    Zhang, Haojie
    Qiu, Yufei
    Zhai, Tong
    Zhang, Zhiguo
    SENSORS, 2024, 24 (09)
  • [44] Self-Supervised Representation Learning for Document Image Classification
    Siddiqui, Shoaib Ahmed
    Dengel, Andreas
    Ahmed, Sheraz
    IEEE ACCESS, 2021, 9 : 164358 - 164367
  • [45] Self-Supervised Viewpoint Learning From Image Collections
    Mustikovela, Siva Karthik
    Jampani, Varun
    De Mello, Shalini
    Liu, Sifei
    Iqbal, Umar
    Rother, Carsten
    Kautz, Jan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3970 - 3980
  • [46] Self-Supervised Deep Unrolled Reconstruction Using Regularization by Denoising
    Huang, Peizhou
    Zhang, Chaoyi
    Zhang, Xiaoliang
    Li, Xiaojuan
    Dong, Liang
    Ying, Leslie
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (03) : 1203 - 1213
  • [47] Selfrec-Net: self-supervised deep learning approach for the reconstruction of Cherenkov-excited luminescence scanned tomography
    Zhang, Wenqian
    Hu, Ting
    Li, Zhe
    Sun, Zhonghua
    Jia, Kebin
    Dou, Huijing
    Feng, Jinchao
    Pogue, Brian W.
    BIOMEDICAL OPTICS EXPRESS, 2023, 14 (02) : 783 - 798
  • [48] iSSL-AL: a deep active learning framework based on self-supervised learning for image classification
    Agha, Rand
    Mustafa, Ahmad M.
    Abuein, Qusai
    Neural Computing and Applications, 2024, 36 (28) : 17699 - 17713
  • [49] Remote sensing image intelligent interpretation: from supervised learning to self-supervised learning
    Tao C.
    Yin Z.
    Zhu Q.
    Li H.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1122 - 1134
  • [50] Self-supervised learning-leveraged boosting ultrasound image segmentation via mask reconstruction
    Sang, Qingbing
    Hou, Yajie
    Qian, Pengjiang
    Wu, Qin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (05) : 2039 - 2048