Accelerating Multiframe Blind Deconvolution via Deep Learning

被引:4
|
作者
Ramos, Andres Asensio [1 ,2 ]
Pozuelo, Sara Esteban [1 ,2 ]
Kuckein, Christoph [1 ,2 ]
机构
[1] Inst Astrofis Canarias, San Cristobal la Laguna 38205, Tenerife, Spain
[2] Univ La Laguna, Dept Astrofis, E-38205 San Cristobal la Laguna, Tenerife, Spain
基金
欧洲研究理事会; 欧盟地平线“2020”;
关键词
Earth's atmosphere; Atmospheric seeing; Instrumentation and data management; IMAGE-RESTORATION; SOLAR; RESOLUTION;
D O I
10.1007/s11207-023-02185-8
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Ground-based solar-image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to apply blind deconvolution techniques. These techniques rely on the observation of many short-exposure frames that are used to simultaneously infer the instantaneous state of the atmosphere and the unperturbed object. We have recently explored the use of machine learning to accelerate this process, with promising results. We build upon this previous work to propose several interesting improvements that lead to better models. Also, we propose a new method to accelerate the restoration based on algorithm unrolling. In this method, the image-restoration problem is solved with a gradient-descent method that is unrolled and accelerated, aided by a few small neural networks. The role of the neural networks is to correct the estimation of the solution at each iterative step. The model is trained to perform the optimization in a small fixed number of steps with a curated dataset. Our findings demonstrate that both methods significantly reduce the restoration time compared to the standard optimization procedure. Furthermore, we showcase that these models can be trained in an unsupervised manner using observed images from three different instruments. Remarkably, they also exhibit robust generalization capabilities when applied to new datasets. To foster further research and collaboration, we openly provide the trained models, along with the corresponding training and evaluation code, as well as the training dataset, to the scientific community.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Fast splitting algorithm for multiframe total variation blind video deconvolution
    Wen, You-Wei
    Liu, Chaoqiang
    Yip, Andy M.
    APPLIED OPTICS, 2010, 49 (15) : 2761 - 2768
  • [32] Efficient Filter Flow for Space-Variant Multiframe Blind Deconvolution
    Hirsch, Michael
    Sra, Suvrit
    Schoelkopf, Bernhard
    Harmeling, Stefan
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 607 - 614
  • [33] Experimental results of parallel multiframe blind deconvolution using wavelength diversity
    Ingleby, HR
    McGaughey, DR
    PHOTONICS NORTH: APPLICATIONS OF PHOTONIC TECHNOLOGY 7B, PTS 1 AND 2: CLOSING THE GAP BETWEEN THEORY, DEVELOPMENT, AND APPLICATION - PHOTONIC APPLICATIONS IN ASTRONOMY, BIOMEDICINE, IMAGING, MATERIALS PROCESSING, AND EDUCATION, 2004, 5578 : 8 - 14
  • [34] Research on blind deconvolution algorithm of multiframe turbulence-degraded images
    Zhang, Lijuan
    Yang, Jinhua
    Su, Wei
    Wang, Xiaokun
    Jiang, Yutong
    Jiang, Chenghao
    Liu, Zhao
    Journal of Information and Computational Science, 2013, 10 (12): : 3625 - 3634
  • [35] Multiframe blind deconvolution with real data: imagery of the Hubble Space Telescope
    Schulz, Timothy J.
    Stribling, Bruce E.
    Miller, Jason J.
    OPTICS EXPRESS, 1997, 1 (11): : 355 - 362
  • [36] TurbuGAN: An Adversarial Learning Approach to Spatially-Varying Multiframe Blind Deconvolution with Applications to Imaging Through Turbulence
    Feng B.Y.
    Xie M.
    Metzler C.A.
    IEEE Journal on Selected Areas in Information Theory, 2022, 3 (03): : 543 - 556
  • [37] Solar multiobject multiframe blind deconvolution with a spatially variant convolution neural emulator
    Ramos, A. Asensio
    ASTRONOMY & ASTROPHYSICS, 2024, 688
  • [38] Parallel Hybrid Bispectrum-Multiframe Blind Deconvolution Algorithm for Horizontal Imaging
    Hajmohammadi, S.
    Nooshabadi, S.
    2016 14TH IEEE INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2016,
  • [39] ACCELERATING MAGNETIC RESONANCE IMAGING VIA DEEP LEARNING
    Wang, Shanshan
    Su, Zhenghang
    Ying, Leslie
    Peng, Xi
    Zhu, Shun
    Liang, Feng
    Feng, Dagan
    Liang, Dong
    2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 514 - 517
  • [40] Multiframe blind deconvolution applied to diverse shift-and-add images of an astronomical object
    Susumu Kuwamura
    Yasuyuki Azuma
    Noriaki Miura
    Fumiaki Tsumuraya
    Makoto Sakamoto
    Naoshi Baba
    Optical Review, 2014, 21 : 9 - 16