Deep learning image denoising based on multi-stage supervised with Res2-Unet

被引:2
|
作者
Liu Y. [1 ]
Chen G. [1 ]
Yu C. [1 ]
Wang S. [2 ]
Sun B. [3 ]
机构
[1] Nanjing University Posts and Telecommunications, College of Electronic and Optical Engineering, Nanjing
[2] Jiangsu North Huguang Opto-Electronics Limited Corporation, Wuxi
[3] Nanjing University Posts and Telecommunications, School of Automation, Nanjing
关键词
channel attention mechanism; image denoising; real noise; residual network; supervisory attention mechanism;
D O I
10.37188/OPE.20233106.0920
中图分类号
学科分类号
摘要
To restore high quality images from different types of noise images,this study developed a multi-stage supervised deep residual(MSDR)neural network based on Res2-Unet-SE. First,using the neural network,the image denoising task was devised as a multi-stage process. Then,in each processing stage,image blocks with different resolutions were input into a Res2-Unet sub-network to obtain feature information at different scales,and an adaptive learning of the feature fusion information was transferred to the next stage through a channel attention mechanism. Finally,the feature information of different scales was superimposed to achieve high-quality image noise reduction. The BSD400 dataset was selected for training in the experiments,and a Gaussian noise reduction test was performed using the Set12 data set. Real noise reduction test was conducted using the SIDD data set. Compared with the common denoising neural network,the peak signal-to-noise ratios(PSNRs)of the proposed denoising convolutional neural network(DnCNN)improved by 0. 03 dB,0. 05 dB,and 0. 14 dB when Gaussian noises of σ = 15,25 and 50,respectively,were added to the image data set. Compared with the latest dual residual block network(DuRN)algorithm,the PSNR of the image denoised using the proposed algorithm was higher by 0. 06 dB,0. 57 dB,and 0. 39 dB,respectively. For images containing real noise,the PSNR of the image denoised by the proposed algorithm was 0. 6 dB higher than that by the convolutional blind denoising network(CBDNET)algorithm. The results indicate that the proposed algorithm is highly robust in the task of image denoising,and it can effectively remove noise and restore the details of an image,as well as fully maintain the global dependence of the image. © 2023 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:920 / 935
页数:15
相关论文
共 21 条
  • [1] KATKOVNIK V,, Et al., Image denoising by sparse 3-D transform-domain collaborative filtering[J], IEEE Transactions on Image Processing, 16, 8, pp. 2080-2095, (2007)
  • [2] ZHANG L, Et al., Weighted Nuclear Norm Minimization with Application to Image Denoising[C], 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862-2869, (2014)
  • [3] JAIN V, MURRAY J F,, ROTH F,, Et al., Supervised Learning of Image Restoration with Convolutional Networks[C], 2007 IEEE 11th International Conference on Computer Vision, pp. 1-8, (2007)
  • [4] ZHANG K, CHEN Y J,, Et al., Beyond a Gaussian denoiser:residual learning of deep CNN for image denoising[J], IEEE Transactions on Image Processing, 26, 7, pp. 3142-3155, (2017)
  • [5] ZHANG K, ZHANG L., FFDNet:toward a fast and flexible solution for CNN-based image denoising[J], IEEE Transactions on Image Processing, 27, 9, pp. 4608-4622, (2018)
  • [6] GUO S, YAN Z F,, ZHANG K,, Et al., Toward Convolutional Blind Denoising of Real Photographs [C], 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1712-1722, (2019)
  • [7] SUN Z,, Et al., Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restoration[C], 2019 IEEE/ CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7000-7009, (2019)
  • [8] ZAMIR S W,, ARORA A, KHAN S,, Et al., Multistage Progressive Image Restoration [C], 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), pp. 14816-14826
  • [9] Squeeze-and-excitation networks[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 8, pp. 2011-2023, (2020)
  • [10] QIN CH, SONG Z Y, ZENG J Y,, Et al., Deeply supervised breast cancer segmentation combined with multi-scale and attention-residuals[J], Opt. Precision Eng, 29, 4, pp. 877-895, (2021)