Connecting image inpainting with denoising in the homogeneous diffusion setting

被引:0
|
作者
Gaa, Daniel [1 ]
Chizhov, Vassillen [1 ]
Peter, Pascal [1 ]
Weickert, Joachim [1 ]
Adam, Robin Dirk [1 ]
机构
[1] Saarland Univ, Fac Math & Comp Sci, Math Image Anal Grp, Campus E1 7, D-66041 Saarbrucken, Germany
来源
基金
欧盟地平线“2020”;
关键词
Diffusion; Denoising; Inpainting; Partial differential equations; Sampling; SCALE-SPACE; REGULARIZATION; COMPRESSION; ALGORITHM; INTERPOLATION; REMOVAL;
D O I
10.1186/s13662-025-03935-7
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
While local methods for image denoising and inpainting may use similar concepts, their connections have hardly been investigated so far. The goal of this work is to establish links between the two by focusing on the most foundational scenario on both sides - the homogeneous diffusion setting. To this end, we study a denoising by inpainting (DbI) framework. It averages multiple inpainting results from different noisy subsets. We derive equivalence results between DbI on shifted regular grids and homogeneous diffusion filtering in 1D via an explicit relation between the density and the diffusion time. We also provide an empirical extension to the 2D case. We present experiments that confirm our theory and suggest that it can also be generalized to diffusions with nonhomogeneous data or nonhomogeneous diffusivities. More generally, our work demonstrates that the hardly explored idea of data adaptivity deserves more attention - it can be as powerful as some popular models with operator adaptivity.
引用
收藏
页数:38
相关论文
共 50 条
  • [1] ORTHOGONAL-DIRECTIONAL FORWARD DIFFUSION IMAGE INPAINTING AND DENOISING MODEL
    Wu Jiying Ruan Qiuqi An Gaoyun(Institute of Information Science
    JournalofElectronics(China), 2008, (05) : 622 - 628
  • [2] Guest Editorial: Image and Video Inpainting and Denoising
    Escalera, Sergio
    Escalante, Hugo Jair
    Baro, Xavier
    Guyon, Isabelle
    Madadi, Meysam
    Wan, Jun
    Ayache, Stephane
    Gucluturk, Yagmur
    Guclu, Umut
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) : 1021 - 1024
  • [3] RePaint: Inpainting using Denoising Diffusion Probabilistic Models
    Lugmayr, Andreas
    Danelljan, Martin
    Romero, Andres
    Yu, Fisher
    Timofte, Radu
    Van Gool, Luc
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11451 - 11461
  • [4] CONFIRMNET: CONVOLUTIONAL FIRMNET AND APPLICATION TO IMAGE DENOISING AND INPAINTING
    Pokala, Praveen Kumar
    Uttam, Prakash Kumar
    Seelamantula, Chandra Sekhar
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8663 - 8667
  • [5] Diversified Image Inpainting With Transformers and Denoising Iterative Refinement
    Xu, Shuzhen
    Xiang, Wenlong
    Lv, Cuicui
    Wang, Shuo
    Liu, Guanhua
    IEEE ACCESS, 2024, 12 : 187068 - 187080
  • [6] Orientation-Matching Minimization for Image Denoising and Inpainting
    Jooyoung Hahn
    Xue-Cheng Tai
    Sofia Borok
    Alfred Marcel Bruckstein
    International Journal of Computer Vision, 2011, 92 : 308 - 324
  • [7] Image inpainting and denoising by nonlinear partial differential equations
    Barcelos, CAZ
    Batista, MA
    XVI BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2003, : 287 - 293
  • [8] Orientation-Matching Minimization for Image Denoising and Inpainting
    Hahn, Jooyoung
    Tai, Xue-Cheng
    Borok, Sofia
    Bruckstein, Alfred Marcel
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 92 (03) : 308 - 324
  • [9] Denoising by Inpainting
    Adam, Robin Dirk
    Peter, Pascal
    Weickert, Joachim
    SCALE SPACE AND VARIATIONAL METHODS IN COMPUTER VISION, SSVM 2017, 2017, 10302 : 121 - 132
  • [10] Face Inpainting Model Based on Denoising Diffusion Probability Models
    Liu, Ji-Hong
    Huang, Xi-Xiong
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2024, 45 (09): : 1227 - 1234