U-net like deep autoencoders for deblurring atmospheric turbulence

被引:22
|
作者
Chen, Gongping [1 ]
Gao, Zhisheng [1 ]
Wang, Qiaolu [1 ]
Luo, Qingqing [1 ]
机构
[1] Xihua Univ, Sch Comp & Software Engn, Chengdu, Sichuan, Peoples R China
关键词
convolutional autoencoder neural networks; U-net like model; space target image; blind restoration; atmospheric turbulence; IMAGE; RESTORATION; DECONVOLUTION;
D O I
10.1117/1.JEI.28.5.053024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A method for geometric distortion correction and space and time-varying blur reduction is proposed, which can recover the high-quality image from a single-frame image distorted by atmospheric turbulence. First, the U-net like deep-stacked autoencoder neural network model is proposed, which is composed of two deep convolutional autoencoder (CAE) neural networks and a U-net. The first CAE is used for feature extraction, the U-net is used for feature deconvolution, and the second CAE is used for image reconstruction. For the loss reduction of image information, transposed convolution instead of upsampling is selected in U-net networks. Moreover, in order to obtain sufficient feature information for reconstruction, the first CAE and the last CAE are symmetric skip connected. This not only enables the fusion of low-level and high-level information but also ensures the integrity of image information greatly. Then, a method of gradually mature training from simple to complex is proposed to overcome the difficulty of convergence on smaller training sets. It makes the network be converged and mature by increasing the complexity of training data gradually so as to restore the high turbulence-degraded image. Experimental results of actual observation data and simulation data show that the algorithm has a stronger antinoise ability and can recover image details and sharpen image edges more effectively. In particular, for atmospheric turbulence severely degraded image restoration, the peak signal-to-noise ratio index is increased by about 10% on average compared with state-of-the-art methods. (C) 2019 SPIE and IS&T.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] New U-Net for Image Deblurring Using Deep Learning
    Jeong W.
    Kim S.
    Lee C.
    Transactions of the Korean Institute of Electrical Engineers, 2023, 72 (07): : 843 - 848
  • [2] An Image Deblurring Method Using Improved U-Net Model
    Lian, Zuozheng
    Wang, Haizhen
    Zhang, Qianjun
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [3] Repairing Highly Corrupted Speech and Images with U-net Autoencoders
    Lee, Michael S.
    Hyatt, John S.
    Edwards, Samuel N.
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS II, 2020, 11413
  • [4] Underwater U-Net: Deep Learning with U-Net for Visual Underwater Moving Object detection
    Bajpai, Vatsalya
    Sharma, Akhilesh
    Subudhi, Badri Narayan
    Veerakumar, T.
    Jakhetiya, Vinit
    OCEANS 2021: SAN DIEGO - PORTO, 2021,
  • [5] GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation
    Li, Yunxiang
    Wang, Shuai
    Wang, Jun
    Zeng, Guodong
    Liu, Wenjun
    Zhang, Qianni
    Jin, Qun
    Wang, Yaqi
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 386 - 395
  • [6] Road Extraction by Deep Residual U-Net
    Zhang, Zhengxin
    Liu, Qingjie
    Wang, Yunhong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (05) : 749 - 753
  • [7] Semantic segmentation of human cell nucleus using deep U-Net and other versions of U-Net models
    Yadavendra
    Chand, Satish
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2022, 33 (3-4) : 167 - 186
  • [8] Deep Upscale U-Net for automatic tongue segmentation
    Worapan Kusakunniran
    Thanandon Imaromkul
    Sophon Mongkolluksamee
    Kittikhun Thongkanchorn
    Panrasee Ritthipravat
    Pimchanok Tuakta
    Paitoon Benjapornlert
    Medical & Biological Engineering & Computing, 2024, 62 : 1751 - 1762
  • [9] Deep Learning Based Model Observer by U-Net
    Lorente, Iris
    Abbey, Craig
    Brankov, Jovan G.
    MEDICAL IMAGING 2020: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2020, 11316
  • [10] CENTER PIVOT CLASSIFICATION WITH DEEP RESIDUAL U-NET
    de Albuquerque, Anesmar Olino
    de Bem, Pablo Pozzobon
    de Moura, Rebeca dos Santos
    Ferreira de Carvalho, Osmar Luiz
    Guimaraes Ferreira, Pedro Henrique
    Silva, Cristiano Rosa
    Trancoso Gomes, Roberto Arnaldo
    Guimaraes, Renato Fontes
    de Carvalho Junior, Osmar Abilio
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1596 - 1599