Self-Supervised Deep Learning for Image Reconstruction: A Langevin Monte Carlo Approach

被引:3
|
作者
Li, Ji [1 ,2 ]
Wang, Weixi [1 ]
Ji, Hui [1 ]
机构
[1] Natl Univ Singapore, Dept Math, Singapore, Singapore
[2] Capital Normal Univ, Acad Multidisciplinary Studies, Beijing, Peoples R China
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2023年 / 16卷 / 04期
关键词
self-supervised learning; inverse problems; image reconstruction; Langevin dynamics; Bayesian inference; PLAY PRIORS; PLUG; RESTORATION; CONVERGENCE;
D O I
10.1137/23M1548025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has proved to be a powerful tool for solving inverse problems in imaging, and most of the related work is based on supervised learning. In many applications, collecting truth images is a challenging and costly task, and the prerequisite of having a training dataset of truth images limits its applicability. This paper proposes a self-supervised deep learning method for solving inverse imaging problems that does not require any training samples. The proposed approach is built on a reparametrization of latent images using a convolutional neural network, and the reconstruction is motivated by approximating the minimum mean square error estimate of the latent image using a Langevin dynamics-based Monte Carlo (MC) method. To efficiently sample the network weights in the context of image reconstruction, we propose a Langevin MC scheme called Adam-LD, inspired by the well-known optimizer in deep learning, Adam. The proposed method is applied to solve linear and nonlinear inverse problems, specifically, sparse-view computed tomography image reconstruction and phase retrieval. Our experiments demonstrate that the proposed method outperforms existing unsupervised or self-supervised solutions in terms of reconstruction quality.
引用
收藏
页码:2247 / 2284
页数:38
相关论文
共 50 条
  • [1] Deep Self-Supervised Hyperspectral Image Reconstruction
    Liu, Zhe
    Han, Xian-Hua
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [2] SELF-SUPERVISED DEEP LEARNING FOR FISHEYE IMAGE RECTIFICATION
    Chao, Chun-Hao
    Hsu, Pin-Lun
    Lee, Hung-Yi
    Wang, Yu-Chiang Frank
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2248 - 2252
  • [3] Self-supervised learning for CT image denoising and reconstruction: a review
    Choi, Kihwan
    BIOMEDICAL ENGINEERING LETTERS, 2024, 14 (06) : 1207 - 1220
  • [4] Self-supervised Deep Image Restoration via Adaptive Stochastic Gradient Langevin Dynamics
    Wang, Weixi
    Li, Ji
    Ji, Hui
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1988 - 1997
  • [5] NVST Image Denoising Based on Self-Supervised Deep Learning
    Lu Xianwei
    Liu Hui
    Shang Zhenhong
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)
  • [6] Comparison between Supervised and Self-supervised Deep Learning for SEM Image Denoising
    Okud, Tomoyuki
    Chen, Jun
    Motoyoshi, Takahiro
    Yumiba, Ryou
    Ishikawa, Masayoshi
    Toyoda, Yasutaka
    METROLOGY, INSPECTION, AND PROCESS CONTROL XXXVII, 2023, 12496
  • [7] ITERATIVE DATA REFINEMENT FOR SELF-SUPERVISED LEARNING MR IMAGE RECONSTRUCTION
    Liu, Xue
    Zou, Juan
    Sun, Tao
    Wu, Ruoyou
    Zheng, Xiawu
    Li, Cheng
    Wang, Shanshan
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [8] Interleaving Monte Carlo Tree Search and Self-Supervised Learning for Object Retrieval in Clutter
    Huang, Baichuan
    Guo, Teng
    Boularias, Abdeslam
    Yu, Jingjin
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [9] CWAN: Self-supervised learning for deep grape disease image composition
    Jin, Haibin
    Chu, Xiaoquan
    Qi, Jianfang
    Zhang, Xinxin
    Mu, Weisong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [10] Astronomical image denoising by self-supervised deep learning and restoration processes
    Liu, Tie
    Quan, Yuhui
    Su, Yingna
    Guo, Yang
    Liu, Shu
    Ji, Haisheng
    Hao, Qi
    Gao, Yulong
    Liu, Yuxia
    Wang, Yikang
    Sun, Wenqing
    Ding, Mingde
    NATURE ASTRONOMY, 2025, : 608 - 615