Multi-scale Deformable Deblurring Kernel Prediction for Dynamic Scene Deblurring

被引:0
|
作者
Zhu, Kai [1 ]
Sang, Nong [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Key Lab Image Proc & Intelligent Control, Wuhan, Peoples R China
来源
关键词
Dynamic scene deblurring; Deformable convolution; Dynamic convolution;
D O I
10.1007/978-3-030-87361-5_21
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deblurring aims to restore clear images from blurred ones. Recently deep learning are widely used. Previous methods regard deblurring as dense prediction problems and rarely consider the inverse operation of blur. In this paper, we propose a multi-scale deformable deblurring kernel prediction network for dynamic scene deblurring which uses a coarse-to-fine method to predict the per-pixel deformable deblurring kernel and uses the fusion weight to integrate the latent images in different scales. Since the spatially variable blur scatters pixel information to surrounding sub-pixels and leads to the spatially and quantitively uneven distribution of latent pixel information, the per-pixel deformable deblurring kernel can adaptively select the sub-pixels and linearly combine them into the clean pixel for information aggregation. The multi-scale architecture helps the deformable deblurring kernel enlarge the reception field. The residual image is added to convolution result in each scale to supply refined edges when the kernel cannot cover the areas existing latent pixel information. Besides, we add local similarity loss to constrain deformable deblurring kernel's weight and offset which boosts the deblurring performance. Qualitative and quantitative experiments show that our method can produce competitive deblurring performance.
引用
收藏
页码:253 / 264
页数:12
相关论文
共 50 条
  • [21] Multi-Scale Neural Network With Dilated Convolutions for Image Deblurring
    Ople, Jose Jaena Mari
    Yeh, Pin-Yi
    Sun, Shih-Wei
    Tsai, I-Te
    Hua, Kai-Lung
    IEEE ACCESS, 2020, 8 : 53942 - 53952
  • [22] Enhanced multi-scale feature progressive network for image Deblurring
    Yu, Zhijun
    Wang, Guodong
    Zhang, Xinyue
    Wang, Ziying
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (14) : 21147 - 21159
  • [23] Multi-scale blind motion deblurring using local minimum
    Wang, Chao
    Sun, LiFeng
    Chen, ZhuoYuan
    Zhang, JianWei
    Yang, ShiQiang
    INVERSE PROBLEMS, 2010, 26 (01)
  • [24] Decoupled Frequency Learning for Dynamic Scene Deblurring
    Liu, Tao
    Tan, Shan
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 89 - 96
  • [25] Dynamic Scene Deblurring by Depth Guided Model
    Li, Lerenhan
    Pan, Jinshan
    Lai, Wei-Sheng
    Gao, Changxin
    Sang, Nong
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 5273 - 5288
  • [26] Segmentation-Free Dynamic Scene Deblurring
    Kim, Tae Hyun
    Lee, Kyoung Mu
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2766 - 2773
  • [27] Structures Guided Dynamic Scene Deblurring Method
    Qi, Qing
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [28] Multi-Scale Low-Rank Blind Image Deblurring Method
    Zhou Z.
    Zhang Y.
    Tang Q.
    Yan J.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2021, 55 (09): : 168 - 177
  • [29] Multi-scale attention in attention neural network for single image deblurring☆
    Lee, Ho Sub
    Cho, Sung In
    DISPLAYS, 2024, 85
  • [30] LIGHTWEIGHT DEEP DEBLURRING MODEL WITH DISCRIMINATIVE MULTI-SCALE FEATURE FUSION
    Lv, Jiangtao
    Pan, Jinshan
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3065 - 3069