Depth-Aware Blind Image Decomposition for Real-World Adverse Weather Recovery

被引:1
|
作者
Wang, Chao [1 ]
Zheng, Zhedong [2 ]
Quan, Ruijie [3 ]
Yang, Yi [3 ]
机构
[1] Univ Technol Sydney, ReLER Lab, AAII, Ultimo, Australia
[2] Univ Macau, FST & ICI, Zhuhai, Peoples R China
[3] Zhejiang Univ, ReLER Lab, CCAI, Hangzhou, Peoples R China
来源
关键词
Image decomposition; Scene depth; Weather recovery; RAINDROP REMOVAL; NETWORK;
D O I
10.1007/978-3-031-73007-8_22
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we delve into Blind Image Decomposition (BID) tailored for real-world scenarios, aiming to uniformly recover images from diverse, unknown weather combinations and intensities. Our investigation uncovers one inherent gap between the controlled lab settings and the complex real-world environments. In particular, existing BID methods and datasets usually overlook the physical property that adverse weather varies with scene depth rather than a uniform depth, thus constraining their efficiency on real-world photos. To address this limitation, we design an end-to-end Depth-aware Blind Network, namely DeBNet, to explicitly learn the depth-aware transmissivity maps, and further predict the depth-guided noise residual to jointly produce the restored output. Moreover, we employ neural architecture search to adaptively find optimal architectures within our specified search space, considering significant shape and structure differences between multiple degradations. To verify the effectiveness, we further introduce two new BID datasets, namely BID-CityScapes and BID-GTAV, which simulate depth-aware degradations on real-world and synthetic outdoor images, respectively. Extensive experiments on both existing and proposed benchmarks show the superiority of our method over state-of-the-art approaches.
引用
收藏
页码:379 / 397
页数:19
相关论文
共 50 条
  • [41] Harnessing real-world depth edges with multiflash imaging
    Raskar, R
    Tan, KH
    Feris, RS
    Turk, M
    Kobler, J
    Yu, JY
    IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2005, 25 (01) : 32 - 38
  • [42] Wearable Visually Assistive Device for Blind People to Appreciate Real-world Scene and Screen Image
    Ai, Jin
    Hu, Menghan
    Li, Guodong
    Zhai, Guangtao
    Zhang, Jian
    Li, Qingli
    Sun, Wendell Q.
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 258 - 258
  • [43] Contrastive adaptive frequency decomposition network guided by haze discrimination for real-world image dehazing
    Mo, Yaozong
    Li, Chaofeng
    DISPLAYS, 2024, 82
  • [44] Contrastive adaptive frequency decomposition network guided by haze discrimination for real-world image dehazing
    Mo, Yaozong
    Li, Chaofeng
    Displays, 2024, 82
  • [45] Real-World Image Denoising with Deep Boosting
    Chen, Chang
    Xiong, Zhiwei
    Tian, Xinmei
    Zha, Zheng-Jun
    Wu, Feng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (12) : 3071 - 3087
  • [46] FaceMatch: Real-World Face Image Retrieval
    Borovikov, Eugene
    Vajda, Szilard
    RECENT TRENDS IN IMAGE PROCESSING AND PATTERN RECOGNITION (RTIP2R 2016), 2017, 709 : 405 - 419
  • [47] Towards Real-world Image Quality Assessment
    Li, Leida
    PROCEEDINGS OF THE 3RD WORKSHOP ON QUALITY OF EXPERIENCE IN VISUAL MULTIMEDIA APPLICATIONS, QOEVMA 2024, 2024, : 1 - 1
  • [48] Toward Real-world Panoramic Image Enhancement
    Zhang, Yupeng
    Zhang, Hengzhi
    Li, Daojing
    Liu, Liyan
    Yi, Hong
    Wang, Wei
    Suitoh, Hiroshi
    Odamaki, Makoto
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2675 - 2684
  • [49] Resonance algorithm for real-world image segmentation
    He, H
    Chen, YQ
    PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : A305 - A308
  • [50] A sparsity-promoting image decomposition model for depth recovery
    Ye, Xinchen
    Zhang, Mingliang
    Yang, Jingyu
    Fan, Xin
    Guo, Fangfang
    PATTERN RECOGNITION, 2020, 107