Single-image reflection removal via self-supervised diffusion models

被引:1
|
作者
Lu, Zhengyang [1 ]
Wang, Weifan [1 ]
Guo, Tianhao [1 ]
Wang, Feng [1 ]
机构
[1] Jiangnan Univ, Sch Design, Wuxi, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2025年 / 81卷 / 01期
基金
中国博士后科学基金;
关键词
Single-image reflection removal; Denoising diffusion models; Cycle consistency; Artifact photography; Digital archiving; SEPARATION; FLASH;
D O I
10.1007/s11227-024-06837-9
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Reflections often degrade the visual quality of images captured through transparent surfaces, and reflection removal methods suffer from the shortage of paired real-world samples. This paper proposes a hybrid approach that combines cycle consistency with denoising diffusion probabilistic models (DDPM) to effectively remove reflections from single images without requiring paired training data. The method introduces a reflective removal network (RRN) that leverages DDPMs to model the decomposition process and recover the transmission image, and a reflective synthesis network (RSN) that re-synthesizes the input image using the separated components through a nonlinear attention-based mechanism. Experimental results demonstrate the effectiveness of the proposed method on the SIR2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$<^>2$$\end{document}, flash-based reflection removal (FRR) dataset, and a newly introduced museum reflection removal (MRR) dataset, showing superior performance compared to state-of-the-art methods.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Self-supervised Single-Image Deconvolution with Siamese Neural Networks
    Papkov, Mikhail
    Palo, Kaupo
    Parts, Leopold
    DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS, DALI 2023, 2024, 14379 : 157 - 166
  • [2] Unsupervised Single-Image Reflection Removal
    khezri, Hamed Rahmani
    Kim, Suhong
    Hefeeda, Mohamed
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4958 - 4971
  • [3] Self-Supervised Single-Image Depth Estimation From Focus and Defocus Clues
    Lu, Yawen
    Milliron, Garrett
    Slagter, John
    Lu, Guoyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6281 - 6288
  • [4] Distilling Reflection Dynamics for Single-Image Reflection Removal
    Zheng, Quanlong
    Qiao, Xiaotian
    Cao, Ying
    Guo, Shi
    Zhang, Lei
    Lau, Rynson
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1886 - 1894
  • [5] Benchmarking Single-Image Reflection Removal Algorithms
    Wan, Renjie
    Shi, Boxin
    Duan, Ling-Yu
    Tan, Ah-Hwee
    Kot, Alex C.
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3942 - 3950
  • [6] Benchmarking Single-Image Reflection Removal Algorithms
    Wan, Renjie
    Shi, Boxin
    Li, Haoliang
    Hong, Yuchen
    Duan, Ling-Yu
    Kot, Alex C.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1424 - 1441
  • [7] A Self-Supervised Bootstrap Method for Single-Image 3D Face Reconstruction
    Xing, Yifan
    Tewari, Rahul
    Mendonc, Paulo R. S.
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1014 - 1023
  • [8] A Self-Supervised CNN for Image Watermark Removal
    Tian, Chunwei
    Zheng, Menghua
    Jiao, Tiancai
    Zuo, Wangmeng
    Zhang, Yanning
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7566 - 7576
  • [9] Animating Landscape: Self-Supervised Learning of Decoupled Motion and Appearance for Single-Image Video Synthesis
    Endo, Yuki
    Kanamori, Yoshihiro
    Kuriyama, Shigeru
    ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):
  • [10] Single-image reflection removal using conditional GANs
    Heo, Miran
    Choe, Yoonsik
    2019 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2019, : 364 - 367