Accelerating Multiframe Blind Deconvolution via Deep Learning

被引:4
|
作者
Ramos, Andres Asensio [1 ,2 ]
Pozuelo, Sara Esteban [1 ,2 ]
Kuckein, Christoph [1 ,2 ]
机构
[1] Inst Astrofis Canarias, San Cristobal la Laguna 38205, Tenerife, Spain
[2] Univ La Laguna, Dept Astrofis, E-38205 San Cristobal la Laguna, Tenerife, Spain
基金
欧洲研究理事会; 欧盟地平线“2020”;
关键词
Earth's atmosphere; Atmospheric seeing; Instrumentation and data management; IMAGE-RESTORATION; SOLAR; RESOLUTION;
D O I
10.1007/s11207-023-02185-8
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Ground-based solar-image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to apply blind deconvolution techniques. These techniques rely on the observation of many short-exposure frames that are used to simultaneously infer the instantaneous state of the atmosphere and the unperturbed object. We have recently explored the use of machine learning to accelerate this process, with promising results. We build upon this previous work to propose several interesting improvements that lead to better models. Also, we propose a new method to accelerate the restoration based on algorithm unrolling. In this method, the image-restoration problem is solved with a gradient-descent method that is unrolled and accelerated, aided by a few small neural networks. The role of the neural networks is to correct the estimation of the solution at each iterative step. The model is trained to perform the optimization in a small fixed number of steps with a curated dataset. Our findings demonstrate that both methods significantly reduce the restoration time compared to the standard optimization procedure. Furthermore, we showcase that these models can be trained in an unsupervised manner using observed images from three different instruments. Remarkably, they also exhibit robust generalization capabilities when applied to new datasets. To foster further research and collaboration, we openly provide the trained models, along with the corresponding training and evaluation code, as well as the training dataset, to the scientific community.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Migration Deconvolution via Deep Learning
    Avila, Manuel Ramon Vargas
    Osorio, Luana Nobre
    de Castro Vargas Fernandes, Julio
    Bulcao, Andre
    Pereira-Dias, Bruno
    de Souza Silva, Bruno
    Barros, Pablo Machado
    Landau, Luiz
    Evsukoff, Alexandre G.
    PURE AND APPLIED GEOPHYSICS, 2021, 178 (05) : 1677 - 1695
  • [22] Migration Deconvolution via Deep Learning
    Manuel Ramón Vargas Avila
    Luana Nobre Osorio
    Júlio de Castro Vargas Fernandes
    André Bulcão
    Bruno Pereira-Dias
    Bruno de Souza Silva
    Pablo Machado Barros
    Luiz Landau
    Alexandre G. Evsukoff
    Pure and Applied Geophysics, 2021, 178 : 1677 - 1695
  • [23] Approaches to convergence enhancement of multiframe blind deconvolution of astronomical images
    Luo Lin
    Wang Li
    Cheng Wei-Dong
    Shen Mang-Zuo
    ACTA PHYSICA SINICA, 2006, 55 (12) : 6708 - 6714
  • [24] Self-Supervised Blind Image Deconvolution via Deep Generative Ensemble Learning
    Chen, Mingqin
    Quan, Yuhui
    Xu, Yong
    Ji, Hui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 634 - 647
  • [25] SEGMENTATION-BASED MULTIFRAME BLIND DECONVOLUTION OF SOLAR IMAGES
    MIURA, N
    BABA, N
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1995, 12 (09): : 1858 - 1866
  • [26] Phase-error compensation through multiframe blind deconvolution
    Schulz, TJ
    Miller, JJ
    Stribling, BE
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, 1996, : 101 - 103
  • [27] Real-time, multiframe, blind deconvolution of solar images
    Asensio Ramos, A.
    Rodriguez, J. de la Cruz
    Pastor Yabar, A.
    ASTRONOMY & ASTROPHYSICS, 2018, 620
  • [28] Practical aspects of multiframe blind deconvolution for ground based telescopes
    Abijaoude, Melena
    Schulz, Timothy
    Gray, David
    Ostroot, Mark
    Pineros, Miguel
    Holmes, Timothy
    UNCONVENTIONAL AND INDIRECT IMAGING, IMAGE RECONSTRUCTION, AND WAVEFRONT SENSING 2018, 2018, 10772
  • [29] Comparison of bispectrum, multiframe blind deconvolution and hybrid bispectrum-multiframe blind deconvolution image reconstruction techniques for anisoplanatic, long horizontal-path imaging
    Archer, Glen E.
    Bos, Jeremy P.
    Roggemann, Michael C.
    OPTICAL ENGINEERING, 2014, 53 (04)
  • [30] Understanding deep learning via backtracking and deconvolution
    Fang X.
    Journal of Big Data, 4 (1)