Prompt-Based Test-Time Real Image Dehazing: A Novel Pipeline

被引:0
|
作者
Chen, Zixuan [1 ]
He, Zewei [1 ,2 ]
Lu, Ziqian [1 ]
Sun, Xuecheng [1 ]
Lu, Zhe-Ming [1 ,2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou, Peoples R China
[2] Huanjiang Lab, Hangzhou, Peoples R China
来源
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Image dehazing; Visual prompt; Feature adaptation;
D O I
10.1007/978-3-031-73116-7_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing methods attempt to improve models' generalization ability on real-world hazy images by exploring well-designed training schemes (e.g., CycleGAN, prior loss). However, most of them need very complicated training procedures to achieve satisfactory results. For the first time, we present a novel pipeline called Prompt-based Test-Time Dehazing (PTTD) to help generate visually pleasing results of real-captured hazy images during the inference phase. We experimentally observe that given a dehazing model trained on synthetic data, fine-tuning the statistics (i.e., mean and standard deviation) of encoding features is able to narrow the domain gap, boosting the performance of real image dehazing. Accordingly, we first apply a prompt generation module (PGM) to generate a visual prompt, which is the reference of appropriate statistical perturbations for mean and standard deviation. Then, we employ a feature adaptation module (FAM) into the existing dehazing models for adjusting the original statistics with the guidance of the generated prompt. PTTD is model-agnostic and can be equipped with various state-of-the-art dehazing models trained on synthetic hazy-clean pairs to tackle the real image dehazing task. Extensive experimental results demonstrate that our PTTD is effective, achieving superior performance against state-of-the-art dehazing methods in real-world scenarios. The code is available at https://github.com/cecret3350/PTTD-Dehazing.
引用
收藏
页码:432 / 449
页数:18
相关论文
共 50 条
  • [21] PromptCast: A New Prompt-Based Learning Paradigm for Time Series Forecasting
    Xue, Hao
    Salim, Flora D.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (11) : 6851 - 6864
  • [22] Novel parametric based time efficient portable real-time dehazing system
    Avra Ghosh
    Asfak Ali
    Sangita Roy
    Sheli Sinha Chaudhuri
    Journal of Real-Time Image Processing, 2023, 20
  • [23] Novel parametric based time efficient portable real-time dehazing system
    Ghosh, Avra
    Ali, Asfak
    Roy, Sangita
    Chaudhuri, Sheli Sinha
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2023, 20 (02)
  • [24] Prompt-Based Transformer for Generalizable Person Re-identification with Image Masking
    Liu, Jialu
    Yang, Meng
    BIOMETRIC RECOGNITION, CCBR 2023, 2023, 14463 : 259 - 268
  • [25] On-the-Fly Test-time Adaptation for Medical Image Segmentation
    Valanarasu, Jeya Maria Jose
    Guo, Pengfei
    Vibashan, V. S.
    Patel, Vishal M.
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 586 - 598
  • [26] Autoencoder based self-supervised test-time adaptation for medical image analysis
    He, Yufan
    Carass, Aaron
    Zuo, Lianrui
    Dewey, Blake E.
    Prince, Jerry L.
    MEDICAL IMAGE ANALYSIS, 2021, 72
  • [27] Infrared and Visible Image Fusion via Test-Time Training
    Zheng, Guoqing
    Fu, Zhenqi
    Lin, Xiaopeng
    Chu, Xueye
    Huang, Yue
    Ding, Xinghao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 77 - 88
  • [28] Test-Time Synthetic-to-Real Adaptive Depth Estimation
    Yi, Eojindl
    Kim, Junmo
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4938 - 4944
  • [29] TEST-TIME ADAPTATION FOR OUT-OF-DISTRIBUTED IMAGE INPAINTING
    Shin, Chajin
    Kim, Taeoh
    Lee, Sangjin
    Lee, Sangyoun
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2009 - 2013
  • [30] Efficient Real-time Single Image Dehazing Based on Color Cube Constraint
    Kponou, Elisee A.
    Wang, Zhengning
    Wei, Ping
    2017 IEEE 2ND INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2017, : 106 - 110