Learning depth-aware decomposition for single image dehazing

被引:0
|
作者
Kang, Yumeng [1 ]
Zhang, Lu [2 ]
Hu, Ping [3 ]
Liu, Yu [4 ]
Lu, Huchuan [2 ]
He, You [4 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
[2] Dalian Univ Technol, Dalian, Peoples R China
[3] Boston Univ, Boston, MA USA
[4] Tsinghua Univ, Beijing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Single image dehazing; Denoising diffusion probabilistic models; Self-supervised learning;
D O I
10.1016/j.cviu.2024.104069
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing under deficient data is an ill-posed and challenging problem. Most existing methods tackle this task by developing either CycleGAN-based hazy-to-clean translation or physical-based haze decomposition. However, geometric structure is often not effectively incorporated in their straightforward hazy-clean projection framework, which might incur inaccurate estimation in distant areas. In this paper, we rethink the image dehazing task and propose a depth-aware perception framework, DehazeDP, , for robust haze decomposition on deficient data. Our DehazeDP is insthe pired by Diffusion Probabilistic Model to form an end-to-end training pipeline that seamlessly ines the hazy image generation with haze disentanglement. Specifically, in the forward phase, the haze is added to a clean image step-by-step according to the depth distribution. Then, in the reverse phase, a unified U-Net is used to predict the haze and recover the clean image progressively. Extensive experiments on public datasets demonstrate that the proposed DehazeDP performs favorably against state-of-the-art approaches. We release the code and models at https://github.com/stallak/DehazeDP.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Single nighttime image dehazing based on image decomposition
    Liu, Yun
    Wang, Anzhi
    Zhou, Hao
    Jia, Pengfei
    SIGNAL PROCESSING, 2021, 183
  • [32] Look Deeper See Richer: Depth-aware Image Paragraph Captioning
    Wang, Ziwei
    Luo, Yadan
    Li, Yang
    Huang, Zi
    Yin, Hongzhi
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 672 - 680
  • [33] Efficient Depth-aware Image Deformation Adaptation for Curved Screen Displays
    Lu, Shao-Ping
    Florea, Ruxandra-Marina
    Cesar, Pablo
    Schelkens, Peter
    Munteanu, Adrian
    PROCEEDINGS OF THE THEMATIC WORKSHOPS OF ACM MULTIMEDIA 2017 (THEMATIC WORKSHOPS'17), 2017, : 442 - 450
  • [34] DINER: Depth-aware Image-based NEural Radiance fields
    Prinzler, Malte
    Hilliges, Otmar
    Thies, Justus
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12449 - 12459
  • [35] Single image dehazing via decomposition and enhancement
    Gu, Bo
    Yao, Haohan
    Sun, Yanjun
    Duan, Zhonghang
    IET IMAGE PROCESSING, 2024, 18 (04) : 1014 - 1027
  • [36] Robust Unpaired Image Dehazing via Density and Depth Decomposition
    Yang, Yang
    Wang, Chaoyue
    Guo, Xiaojie
    Tao, Dacheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (05) : 1557 - 1577
  • [37] Depth-Aware Video Frame Interpolation
    Bao, Wenbo
    Lai, Wei-Sheng
    Ma, Chao
    Zhang, Xiaoyun
    Gao, Zhiyong
    Yang, Ming-Hsuan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3698 - 3707
  • [38] Depth-Aware Endoscopic Video Inpainting
    Zhang, Francis Xiatian
    Chen, Shuang
    Xie, Xianghua
    Shum, Hubert P. H.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 143 - 153
  • [39] Robust Unpaired Image Dehazing via Density and Depth Decomposition
    Yang Yang
    Chaoyue Wang
    Xiaojie Guo
    Dacheng Tao
    International Journal of Computer Vision, 2024, 132 : 1557 - 1577
  • [40] PolyphonicFormer: Unified Query Learning for Depth-Aware Video Panoptic Segmentation
    Yuan, Haobo
    Li, Xiangtai
    Yang, Yibo
    Cheng, Guangliang
    Zhang, Jing
    Tong, Yunhai
    Zhang, Lefei
    Tao, Dacheng
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 582 - 599