Prompt-Based Test-Time Real Image Dehazing: A Novel Pipeline

被引:0
|
作者
Chen, Zixuan [1 ]
He, Zewei [1 ,2 ]
Lu, Ziqian [1 ]
Sun, Xuecheng [1 ]
Lu, Zhe-Ming [1 ,2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou, Peoples R China
[2] Huanjiang Lab, Hangzhou, Peoples R China
来源
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Image dehazing; Visual prompt; Feature adaptation;
D O I
10.1007/978-3-031-73116-7_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing methods attempt to improve models' generalization ability on real-world hazy images by exploring well-designed training schemes (e.g., CycleGAN, prior loss). However, most of them need very complicated training procedures to achieve satisfactory results. For the first time, we present a novel pipeline called Prompt-based Test-Time Dehazing (PTTD) to help generate visually pleasing results of real-captured hazy images during the inference phase. We experimentally observe that given a dehazing model trained on synthetic data, fine-tuning the statistics (i.e., mean and standard deviation) of encoding features is able to narrow the domain gap, boosting the performance of real image dehazing. Accordingly, we first apply a prompt generation module (PGM) to generate a visual prompt, which is the reference of appropriate statistical perturbations for mean and standard deviation. Then, we employ a feature adaptation module (FAM) into the existing dehazing models for adjusting the original statistics with the guidance of the generated prompt. PTTD is model-agnostic and can be equipped with various state-of-the-art dehazing models trained on synthetic hazy-clean pairs to tackle the real image dehazing task. Extensive experimental results demonstrate that our PTTD is effective, achieving superior performance against state-of-the-art dehazing methods in real-world scenarios. The code is available at https://github.com/cecret3350/PTTD-Dehazing.
引用
收藏
页码:432 / 449
页数:18
相关论文
共 50 条
  • [41] Adapting Vision-Language Models to Open Classes via Test-Time Prompt Tuning
    Gao, Zhengqing
    Ao, Xiang
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    PATTERN RECOGNITION AND COMPUTER VISION, PT V, PRCV 2024, 2025, 15035 : 439 - 452
  • [42] One-Shot Image Learning Using Test-Time Augmentation
    Yamada, Keiichi
    Matsumi, Susumu
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 3 - 16
  • [43] Training- and Test-Time Data Augmentation for Hyperspectral Image Segmentation
    Nalepa, Jakub
    Myller, Michal
    Kawulok, Michal
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (02) : 292 - 296
  • [44] Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
    Shu, Manli
    Nie, Weili
    Huang, De-An
    Yu, Zhiding
    Goldstein, Tom
    Anandkumar, Anima
    Xiao, Chaowei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [45] Test-time adaptable neural networks for robust medical image segmentation
    Karani, Neerav
    Erdil, Ertunc
    Chaitanya, Krishna
    Konukoglu, Ender
    MEDICAL IMAGE ANALYSIS, 2021, 68
  • [46] Improving Medical Image Segmentation Using Test-Time Augmentation with MedSAM
    Nazzal, Wasfieh
    Thurnhofer-Hemsi, Karl
    Lopez-Rubio, Ezequiel
    MATHEMATICS, 2024, 12 (24)
  • [47] Self-supervised Test-Time Adaptation for Medical Image Segmentation
    Li, Hao
    Liu, Han
    Hu, Dewei
    Wang, Jiacheng
    Johnson, Hans
    Sherbini, Omar
    Gavazzi, Francesco
    D'Aiello, Russell
    Vanderver, Adeline
    Long, Jeffrey
    Paulsen, Jane
    Oguz, Ipek
    MACHINE LEARNING IN CLINICAL NEUROIMAGING, MLCN 2022, 2022, 13596 : 32 - 41
  • [48] Test-Time Stain Adaptation with Diffusion Models for Histopathology Image Classification
    Tsai, Cheng-Chang
    Chen, Yuan-Chih
    Lu, Chun-Shien
    COMPUTER VISION-ECCV 2024, PT XXXV, 2025, 15093 : 257 - 275
  • [49] TAAL: Test-Time Augmentation for Active Learning in Medical Image Segmentation
    Gaillochet, Melanie
    Desrosiers, Christian
    Lombaert, Herve
    DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS (DALI 2022), 2022, 13567 : 43 - 53
  • [50] Test-Time Training for Deformable Multi-Scale Image Registration
    Zhu, Wentao
    Huang, Yufang
    Xu, Daguang
    Qian, Zhen
    Fan, Wei
    Xie, Xiaohui
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 13618 - 13625