A Hybrid Inpainting Model Combining Diffusion and Enhanced Exemplar Methods

被引:2
|
作者
Sreelakshmy, I. J. [1 ]
Kovoor, Binsu C. [1 ]
机构
[1] Cochin Univ Sci & Technol, Kochi, Kerala, India
来源
关键词
Hybrid inpainting; Exemplar-based inpainting; Diffusion-based inpainting; Discrete wavelet Transforms; Hough Transforms; TEXTURE SYNTHESIS; IMAGE; ALGORITHM;
D O I
10.1145/3418035
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting is a technique in the world of image editing where missing portions of the image are estimated and filled with the help of available or external information. In the proposed model, a novel hybrid inpainting algorithm is implemented, which adds the benefits of a diffusion-based inpainting method to an enhanced exemplar algorithm. The structure part of the image is dealt with a diffusion-based method, followed by applying an adaptive patch size-based exemplar inpainting. Due to its hybrid nature, the proposed model exceeds the quality of output obtained by applying conventional methods individually. A new term, coefficient of smoothness, is introduced in the model, which is used in the computation of adaptive patch size for the enhanced exemplar method. An automatic mask generation module relieves the user from the burden of creating additional mask input. Quantitative and qualitative evaluation is performed on images from various datasets. The results provide a testimonial to the fact that the proposed model is faster in the case of smooth images. Moreover, the proposed model provides good quality results while inpainting natural images with both texture and structure regions.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Hybrid methods combining computational methods and experimental measurements for dynamic fracture studies
    Nishioka, T
    COMPUTATIONAL METHODS AND EXPERIMENTAL MEASUREMENTS X, 2001, 3 : 525 - 534
  • [42] An Enhanced Hybrid Battery Model
    Kim, Taesic
    Qiao, Wei
    Qu, Liyan
    IEEE TRANSACTIONS ON ENERGY CONVERSION, 2019, 34 (04) : 1848 - 1858
  • [43] Learning From Missing Feedback: Exemplar Versus Model-Based Methods
    Denrell, Jerker
    Sanborn, Adam N.
    Spicer, Jake
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2024,
  • [44] Inpainting Algorithm for Dunhuang Mural Based on Improved Curvature-Driven Diffusion Model
    Chen Y.
    Ai Y.
    Guo H.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (05): : 787 - 796
  • [45] Combining salience and temporal diffusion to model spatial attention
    MacInnes, W. Joseph
    PERCEPTION, 2021, 50 (1_SUPPL) : 38 - 38
  • [46] Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model
    Yang, Shiyuan
    Chen, Xiaodong
    Liao, Jing
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3190 - 3199
  • [47] CIDM: A comprehensive inpainting diffusion model for missing weather radar data with knowledge guidance☆
    Zhang, Wei
    Zhang, Xinyu
    Dong, Junyu
    Song, Xiaojiang
    Pang, Renbo
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2025, 221 : 299 - 309
  • [48] HYBRID TECHNIQUE FOR COMBINING MOMENT METHODS WITH GEOMETRICAL THEORY OF DIFFRACTION
    THIELE, GA
    NEWHOUSE, TH
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 1975, AP23 (01) : 62 - 69
  • [49] Hybrid computational methods combining experimental information with molecular dynamics
    Mondal, Arup
    Lenz, Stefan
    MacCallum, Justin L.
    Perez, Alberto
    CURRENT OPINION IN STRUCTURAL BIOLOGY, 2023, 81
  • [50] Effective image and video error concealment using RST-invariant partial patch matching model and exemplar-based inpainting
    Ahmad, Shiraz
    Lu, Zhe-Ming
    World Academy of Science, Engineering and Technology, 2009, 32 : 910 - 915