End-to-End Learning for Image Burst Deblurring

被引:7
|
作者
Wieschollek, Patrick [1 ,2 ]
Schoelkopf, Bernhard [1 ]
Lensch, Hendrik P. A. [2 ]
Hirsch, Michael [1 ]
机构
[1] Max Planck Inst Intelligent Syst, Stuttgart, Germany
[2] Univ Tubingen, Tubingen, Germany
来源
关键词
This work has been partially supported by the DFG Emmy Noether fellowship Le 1341/1-1 and an NVIDIA hardware grant;
D O I
10.1007/978-3-319-54190-7_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a neural network model approach for multi-frame blind deconvolution. The discriminative approach adopts and combines two recent techniques for image deblurring into a single neural network architecture. Our proposed hybrid-architecture combines the explicit prediction of a deconvolution filter and non-trivial averaging of Fourier coefficients in the frequency domain. In order to make full use of the information contained in all images in one burst, the proposed network embeds smaller networks, which explicitly allow the model to transfer information between images in early layers. Our system is trained end-to-end using standard backpropagation on a set of artificially generated training examples, enabling competitive performance in multi-frame blind deconvolution, both with respect to quality and runtime.
引用
收藏
页码:35 / 51
页数:17
相关论文
共 50 条
  • [31] End-to-end learning for image-based air quality level estimation
    Chao Zhang
    Junchi Yan
    Changsheng Li
    Hao Wu
    Rongfang Bie
    Machine Vision and Applications, 2018, 29 : 601 - 615
  • [32] Learning True Rate-Distortion-Optimization for End-To-End Image Compression
    Brand, Fabian
    Fischer, Kristian
    Kopte, Alexander
    Kaup, Andre
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 443 - 443
  • [33] Deep one-class probability learning for end-to-end image classification
    Liu, Jia
    Zhang, Wenhua
    Liu, Fang
    Yang, Jingxiang
    Xiao, Liang
    NEURAL NETWORKS, 2025, 185
  • [34] Modal Contrastive Learning Based End-to-End Text Image Machine Translation
    Ma, Cong
    Han, Xu
    Wu, Linghui
    Zhang, Yaping
    Zhao, Yang
    Zhou, Yu
    Zong, Chengqing
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 2153 - 2165
  • [35] END-TO-END LEARNING FOR MUSIC AUDIO
    Dieleman, Sander
    Schrauwen, Benjamin
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [36] End-to-End Deep Learning CT Image Reconstruction for Metal Artifact Reduction
    Bauer, Dominik F.
    Ulrich, Constantin
    Russ, Tom
    Golla, Alena-Kathrin
    Schad, Lothar R.
    Zoellner, Frank G.
    APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [37] Unified medical image segmentation by learning from uncertainty in an end-to-end manner
    Tang, Pin
    Yang, Pinli
    Nie, Dong
    Wu, Xi
    Zhou, Jiliu
    Wang, Yan
    KNOWLEDGE-BASED SYSTEMS, 2022, 241
  • [38] An End-to-End Image Retrieval System Based on Gravitational Field Deep Learning
    Zheng, Qinghe
    Yang, Mingqiang
    Zhang, Qingrui
    Zhang, Xinxin
    Yang, Jiajie
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 936 - 940
  • [39] Recognizing Multiple Text Sequences from an Image by Pure End-to-End Learning
    Xu, Zhenlong
    Zhou, Shuigeng
    Bai, Fan
    Cheng, Zhanzhan
    Niu, Yi
    Pu, Shiliang
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7058 - 7065
  • [40] End-to-end learning for joint depth and image reconstruction from diffracted rotation
    Mel, Mazen
    Siddiqui, Muhammad
    Zanuttigh, Pietro
    VISUAL COMPUTER, 2024, 40 (09): : 5961 - 5977