Depth-Aware Blind Image Decomposition for Real-World Adverse Weather Recovery

被引:1
|
作者
Wang, Chao [1 ]
Zheng, Zhedong [2 ]
Quan, Ruijie [3 ]
Yang, Yi [3 ]
机构
[1] Univ Technol Sydney, ReLER Lab, AAII, Ultimo, Australia
[2] Univ Macau, FST & ICI, Zhuhai, Peoples R China
[3] Zhejiang Univ, ReLER Lab, CCAI, Hangzhou, Peoples R China
来源
关键词
Image decomposition; Scene depth; Weather recovery; RAINDROP REMOVAL; NETWORK;
D O I
10.1007/978-3-031-73007-8_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we delve into Blind Image Decomposition (BID) tailored for real-world scenarios, aiming to uniformly recover images from diverse, unknown weather combinations and intensities. Our investigation uncovers one inherent gap between the controlled lab settings and the complex real-world environments. In particular, existing BID methods and datasets usually overlook the physical property that adverse weather varies with scene depth rather than a uniform depth, thus constraining their efficiency on real-world photos. To address this limitation, we design an end-to-end Depth-aware Blind Network, namely DeBNet, to explicitly learn the depth-aware transmissivity maps, and further predict the depth-guided noise residual to jointly produce the restored output. Moreover, we employ neural architecture search to adaptively find optimal architectures within our specified search space, considering significant shape and structure differences between multiple degradations. To verify the effectiveness, we further introduce two new BID datasets, namely BID-CityScapes and BID-GTAV, which simulate depth-aware degradations on real-world and synthetic outdoor images, respectively. Extensive experiments on both existing and proposed benchmarks show the superiority of our method over state-of-the-art approaches.
引用
收藏
页码:379 / 397
页数:19
相关论文
共 50 条
  • [21] MULTIPLE PATCH-AWARE NETWORK FOR FASTER REAL-WORLD IMAGE DEHAZING
    Yang, Kun
    Zhang, Juan
    Lang, Xiaoqi
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2095 - 2099
  • [22] SLIDE: Single image 3D photography with soft layering and depth-aware inpainting
    Jampani, Varun
    Chang, Huiwen
    Sargent, Kyle
    Kar, Abhishek
    Tucker, Richard
    Krainin, Michael
    Kaeser, Dominik
    Freeman, William T.
    Salesin, David
    Curless, Brian
    Liu, Ce
    arXiv, 2021,
  • [23] Single Image Dehazing With Depth-Aware Non-Local Total Variation Regularization
    Liu, Qi
    Gao, Xinbo
    He, Lihuo
    Lu, Wen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 5178 - 5191
  • [24] DA-RAW: Domain Adaptive Object Detection for Real-World Adverse Weather Conditions
    Jeon, Minsik
    Seo, Junwon
    Min, Jihong
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 2013 - 2020
  • [25] Layered Hole Filling Based on Depth-Aware Decomposition and GAN-Enhanced Background Reconstruction for DIBR
    Liu, Ran
    Ren, Xiwei
    An, Hui
    Yi, Lin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12466 - 12479
  • [26] Color Image Reconstruction from a Depth-Aware LCD Display Based on Coded Aperture Imaging
    Suh, Sunoloo
    Choi, Changkyu
    Park, Dusik
    Kim, Changyeong
    IDW/AD '12: PROCEEDINGS OF THE INTERNATIONAL DISPLAY WORKSHOPS, PT 2, 2012, 19 : 1545 - 1548
  • [27] SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting
    Jampani, Varun
    Chang, Huiwen
    Sargent, Kyle
    Kar, Abhishek
    Tucker, Richard
    Krainin, Michael
    Kaeser, Dominik
    Freeman, William T.
    Salesin, David
    Curless, Brian
    Liu, Ce
    Proceedings of the IEEE International Conference on Computer Vision, 2021, : 12498 - 12507
  • [28] SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting
    Jampani, Varun
    Chang, Huiwen
    Sargent, Kyle
    Kar, Abhishek
    Tucker, Richard
    Krainin, Michael
    Kaeser, Dominik
    Freeman, William T.
    Salesin, David
    Curless, Brian
    Liu, Ce
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12498 - 12507
  • [29] Image Dehazing Assessment: A Real-World Dataset and a Haze Density-Aware Criteria
    Chen, Jiyou
    Yang, Gaobo
    Wang, Shengchun
    Wang, Dewang
    Liao, Xin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6037 - 6049
  • [30] A Hardware-Aware Network for Real-World Single Image Super-Resolutions
    Ma R.
    Du X.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (07): : 1 - 15