Importing Diffusion and Re-Designed Backward Process for Image De-Raining

被引:0
|
作者
Lin, Jhe-Wei [1 ]
Lee, Cheng-Hsuan [1 ]
Su, Tang-Wei [1 ]
Chang, Che-Cheng [1 ]
机构
[1] Feng Chia Univ, Dept Informat Engn & Comp Sci, Taichung 407, Taiwan
关键词
image process; diffusion model; de-rained; feature extraction;
D O I
10.3390/s24123715
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In recent years, with the increasing demand for high-quality images in various fields, more and more attention has been focused on noise removal techniques for image processing. The effective elimination of unwanted noise plays a crucial role in improving image quality. To meet this challenge, many noise removal methods have been proposed, among which the diffusion model has become one of the focuses of many researchers. In order to make the restored image closer to the real image and retain more features of the image, this paper proposes a DIR-SDE method with reference to the diffusion models of IR-SDE and IDM, which improve the feature retention of the image in the de-raining process, and then improve the realism of the image for the image de-raining task. In this study, IR-SDE was used as the base structure of the diffusion model, IR-SDE was improved, and DINO-ViT was combined to enhance the image features. During the diffusion process, the image features were extracted using DINO-ViT, and these features were fused with the original images to enhance the learning effect of the model. The model was also trained and validated with the Rain100H dataset. Compared with the IR-SDE method, it improved 0.003 in the SSIM, 0.003 in the LPIPS, and 1.23 in the FID. The experimental results show that the diffusion model proposed in this study can effectively improve the image restoration performance.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Image De-Raining Transformer
    Xiao, Jie
    Fu, Xueyang
    Liu, Aiping
    Wu, Feng
    Zha, Zheng-Jun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 12978 - 12995
  • [2] Morphological networks for image de-raining
    Mondal, Ranjan
    Purkait, Pulak
    Santra, Sanchayan
    Chanda, Bhabatosh
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2019, 11414 LNCS : 262 - 275
  • [3] Morphological Networks for Image De-raining
    Mondal, Ranjan
    Purkait, Pulak
    Santra, Sanchayan
    Chanda, Bhabatosh
    DISCRETE GEOMETRY FOR COMPUTER IMAGERY, DGCI 2019, 2019, 11414 : 262 - 275
  • [4] Gradual Network for Single Image De-raining
    Yu, Weijiang
    Huang, Zhe
    Zhang, Wayne
    Feng, Litong
    Xiao, Nong
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1795 - 1804
  • [5] Image De-raining via Continual Learning
    Zhou, Man
    Xiao, Jie
    Chang, Yifan
    Fu, Xueyang
    Liu, Aiping
    Pan, Jinshan
    Zha, Zheng-Jun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4905 - 4914
  • [6] Successive Graph Convolutional Network for Image De-raining
    Xueyang Fu
    Qi Qi
    Zheng-Jun Zha
    Xinghao Ding
    Feng Wu
    John Paisley
    International Journal of Computer Vision, 2021, 129 : 1691 - 1711
  • [7] Learning Dual Convolutional Dictionaries for Image De-raining
    Ge, Chengjie
    Fu, Xueyang
    Zha, Zheng-Jun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6636 - 6644
  • [8] Confidence Measure Guided Single Image De-Raining
    Yasarla, Rajeev
    Patel, Vishal M.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4544 - 4555
  • [9] Successive Graph Convolutional Network for Image De-raining
    Fu, Xueyang
    Qi, Qi
    Zha, Zheng-Jun
    Ding, Xinghao
    Wu, Feng
    Paisley, John
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (05) : 1691 - 1711
  • [10] Incremental Image De-raining via Associative Memory
    Gu, Yi
    Wang, Chao
    Li, Jie
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 685 - 693