Depth-Aware Blind Image Decomposition for Real-World Adverse Weather Recovery

被引:1
|
作者
Wang, Chao [1 ]
Zheng, Zhedong [2 ]
Quan, Ruijie [3 ]
Yang, Yi [3 ]
机构
[1] Univ Technol Sydney, ReLER Lab, AAII, Ultimo, Australia
[2] Univ Macau, FST & ICI, Zhuhai, Peoples R China
[3] Zhejiang Univ, ReLER Lab, CCAI, Hangzhou, Peoples R China
来源
关键词
Image decomposition; Scene depth; Weather recovery; RAINDROP REMOVAL; NETWORK;
D O I
10.1007/978-3-031-73007-8_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we delve into Blind Image Decomposition (BID) tailored for real-world scenarios, aiming to uniformly recover images from diverse, unknown weather combinations and intensities. Our investigation uncovers one inherent gap between the controlled lab settings and the complex real-world environments. In particular, existing BID methods and datasets usually overlook the physical property that adverse weather varies with scene depth rather than a uniform depth, thus constraining their efficiency on real-world photos. To address this limitation, we design an end-to-end Depth-aware Blind Network, namely DeBNet, to explicitly learn the depth-aware transmissivity maps, and further predict the depth-guided noise residual to jointly produce the restored output. Moreover, we employ neural architecture search to adaptively find optimal architectures within our specified search space, considering significant shape and structure differences between multiple degradations. To verify the effectiveness, we further introduce two new BID datasets, namely BID-CityScapes and BID-GTAV, which simulate depth-aware degradations on real-world and synthetic outdoor images, respectively. Extensive experiments on both existing and proposed benchmarks show the superiority of our method over state-of-the-art approaches.
引用
收藏
页码:379 / 397
页数:19
相关论文
共 50 条
  • [31] Real-world Underwater Image Enhancement via Degradation-aware Dynamic Network
    Qian, Haotian
    Tong, Wentao
    Mu, Pan
    Liu, Zheyuan
    Xu, Harming
    PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 530 - 541
  • [32] DCD-Net: Weakly supervised decomposition learning for real-world image dehazing
    Huang, Yi
    Dong, Yu
    Huang, Jiancheng
    Yan, Mingfu
    Chen, Shifeng
    SIGNAL PROCESSING, 2025, 230
  • [33] Unsupervised Degradation Aware and Representation for Real-World Remote Sensing Image Super-Resolution
    Guo, Wen-Zhong
    Weng, Wu-Ding
    Chen, Guang-Yong
    Su, Jian-Nan
    Gan, Min
    Philip Chen, C. L.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 1
  • [34] Frequency-Aware Degradation Modeling for Real-World Thermal Image Super-Resolution
    Qu, Chao
    Chen, Xiaoyu
    Xu, Qihan
    Han, Jing
    ENTROPY, 2024, 26 (03)
  • [35] Context-aware Pretraining for Efficient Blind Image Decomposition
    Wang, Chao
    Zheng, Zhedong
    Quan, Ruijie
    Sun, Yifan
    Yang, Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18186 - 18195
  • [36] Self-Supervised Image Denoising for Real-World Images With Context-Aware Transformer
    Zhang, Dan
    Zhou, Fangfang
    IEEE ACCESS, 2023, 11 : 14340 - 14349
  • [37] Unsupervised Real-world Image Super Resolution via Domain-distance Aware Training
    Wei, Yunxuan
    Gu, Shuhang
    Li, Yawei
    Timofte, Radu
    Jin, Longcun
    Song, Hengjie
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13380 - 13389
  • [38] ReCQ: Real-world context-aware queryingt
    Hattori, Shun
    Tezuka, Taro
    Ohshima, Hiroaki
    Oyama, Satoshi
    Kawamoto, Junpei
    Tajima, Keishi
    Tanaka, Katsumi
    MODELING AND USING CONTEXT, 2007, 4635 : 248 - +
  • [39] Using a decompiler for real-world source recovery
    Van Emmerik, M
    Waddington, T
    11TH WORKING CONFERENCE ON REVERSE ENGINEERING, PROCEEDINGS, 2004, : 27 - 36
  • [40] In-depth real-world bicycle accident reconstructions
    Bourdet, N.
    Deck, C.
    Serre, T.
    Perrin, C.
    Llari, M.
    Willinger, R.
    INTERNATIONAL JOURNAL OF CRASHWORTHINESS, 2014, 19 (03) : 222 - 232