Depth-Aware Blind Image Decomposition for Real-World Adverse Weather Recovery

被引:1
|
作者
Wang, Chao [1 ]
Zheng, Zhedong [2 ]
Quan, Ruijie [3 ]
Yang, Yi [3 ]
机构
[1] Univ Technol Sydney, ReLER Lab, AAII, Ultimo, Australia
[2] Univ Macau, FST & ICI, Zhuhai, Peoples R China
[3] Zhejiang Univ, ReLER Lab, CCAI, Hangzhou, Peoples R China
来源
关键词
Image decomposition; Scene depth; Weather recovery; RAINDROP REMOVAL; NETWORK;
D O I
10.1007/978-3-031-73007-8_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we delve into Blind Image Decomposition (BID) tailored for real-world scenarios, aiming to uniformly recover images from diverse, unknown weather combinations and intensities. Our investigation uncovers one inherent gap between the controlled lab settings and the complex real-world environments. In particular, existing BID methods and datasets usually overlook the physical property that adverse weather varies with scene depth rather than a uniform depth, thus constraining their efficiency on real-world photos. To address this limitation, we design an end-to-end Depth-aware Blind Network, namely DeBNet, to explicitly learn the depth-aware transmissivity maps, and further predict the depth-guided noise residual to jointly produce the restored output. Moreover, we employ neural architecture search to adaptively find optimal architectures within our specified search space, considering significant shape and structure differences between multiple degradations. To verify the effectiveness, we further introduce two new BID datasets, namely BID-CityScapes and BID-GTAV, which simulate depth-aware degradations on real-world and synthetic outdoor images, respectively. Extensive experiments on both existing and proposed benchmarks show the superiority of our method over state-of-the-art approaches.
引用
收藏
页码:379 / 397
页数:19
相关论文
共 50 条
  • [1] From depth-aware haze generation to real-world haze removal
    Jiyou Chen
    Gaobo Yang
    Ming Xia
    Dengyong Zhang
    Neural Computing and Applications, 2023, 35 : 8281 - 8293
  • [2] From depth-aware haze generation to real-world haze removal
    Chen, Jiyou
    Yang, Gaobo
    Xia, Ming
    Zhang, Dengyong
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 8281 - 8293
  • [3] Learning depth-aware decomposition for single image dehazing
    Kang, Yumeng
    Zhang, Lu
    Hu, Ping
    Liu, Yu
    Lu, Huchuan
    He, You
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 248
  • [4] Depth-Aware Image Seam Carving
    Shen, Jianbing
    Wang, Dapeng
    Li, Xuelong
    IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (05) : 1453 - 1461
  • [5] Depth-Aware Image Colorization Network
    Chu, Wei-Ta
    Hsu, Yu-Ting
    PROCEEDINGS OF THE 2018 WORKSHOP ON UNDERSTANDING SUBJECTIVE ATTRIBUTES OF DATA, WITH THE FOCUS ON EVOKED EMOTIONS (EE-USAD'18), 2018, : 17 - 23
  • [6] Depth-aware image vectorization and editing
    Shufang Lu
    Wei Jiang
    Xuefeng Ding
    Craig S. Kaplan
    Xiaogang Jin
    Fei Gao
    Jiazhou Chen
    The Visual Computer, 2019, 35 : 1027 - 1039
  • [7] Depth-aware image vectorization and editing
    Lu, Shufang
    Jiang, Wei
    Ding, Xuefeng
    Kaplan, Craig S.
    Jin, Xiaogang
    Gao, Fei
    Chen, Jiazhou
    VISUAL COMPUTER, 2019, 35 (6-8): : 1027 - 1039
  • [8] Interactive Depth-Aware Effects for Stereo Image Editing
    Abbott, Joshua
    Morse, Bryan
    2013 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2013), 2013, : 263 - 270
  • [9] Deep Image Registration With Depth-Aware Homography Estimation
    Huang, Chenwei
    Pan, Xiong
    Cheng, Jingchun
    Song, Jiajie
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 6 - 10
  • [10] REINFORCED DEPTH-AWARE DEEP LEARNING FOR SINGLE IMAGE DEHAZING
    Guo, Tiantong
    Monga, Vishal
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 8891 - 8895