Rethinking all-in-one adverse weather removal for object detection

被引:0
|
作者
Li, Yufeng [1 ]
Chen, Jiayu [1 ]
Xie, Chuanlong [1 ]
Chen, Hongming [1 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect Informat Engn, Shenyang 110136, Peoples R China
关键词
All-in-one image restoration; Adverse weather; Object detection; Prompt learning; Vision MLP;
D O I
10.1007/s11760-024-03493-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite significant progress has been made in image restoration under adverse weather conditions, these methods primarily focus on the quality of image reconstruction, leaving their impact on downstream object detection unknown. In this paper, we rethink all-in-one adverse weather removal for object detection. Specifically, we contribute the first multi-weather image restoration dataset tailored for autonomous driving scenarios, comprising 6000 image pairs along with object detection labels, named Multi-Weather6k. Based on this dataset, we conduct a benchmark study on existing methods for joint image restoration and object detection. Furthermore, we develop an effective MLP-based all-in-one image de-weathering framework to better solve this task. The proposed architecture consists of the feature mixing block and the feature prompt block. The former enhances feature modeling by exploiting global and local correlations, while the latter guides image restoration by modulating multi-degraded features using prompt learning. Experimental results show that our proposed method not only achieves consistently superior restoration performance across various weather degradation scenarios but also yields improved object detection results, outperforming the state-of-the-art approaches. The dataset will be available to the public.
引用
收藏
页码:8597 / 8606
页数:10
相关论文
共 50 条
  • [31] All-in-one motion
    Batchelor, Judith
    SMITH COLLEGE STUDIES IN SOCIAL WORK, 2006, 76 (04) : 55 - 58
  • [32] An all-in-one phone
    Kirvaitis, A
    FORTUNE, 2001, 144 (01) : 20 - +
  • [33] THE ALL-IN-ONE DOS
    UDELL, J
    BYTE, 1991, 16 (07): : 36 - &
  • [34] All-In-One Detection, Removal and Recovery of Hg2+ in Industrial Wastewater with Plasmonic Schottky Heterostructures
    Wang, Jun
    Liu, Shenghong
    Liu, Teng
    Wang, Jing
    Liu, Fangyang
    Jia, Ming
    Li, Jie
    Lai, Yanqing
    Zhao, Yinghe
    Jiang, Liangxing
    Li, Yuan
    Zhai, Tianyou
    ADVANCED FUNCTIONAL MATERIALS, 2023, 33 (46)
  • [35] Navigation surgery with an all-in-one splint for impacted tooth root removal
    Maeda, Keigo
    Yamamoto, Shinsuke
    Nashi, Masanori
    Mukainaka, Yumika
    Taniike, Naoki
    Takenobu, Toshihiko
    JOURNAL OF ORAL AND MAXILLOFACIAL SURGERY MEDICINE AND PATHOLOGY, 2020, 32 (04) : 296 - 299
  • [36] All-in-One Framework for Detection, Unpacking, and Verification for Malware Analysis
    Choi, Mi-Jung
    Bang, Jiwon
    Kim, Jongwook
    Kim, Hajin
    Moon, Yang-Sae
    SECURITY AND COMMUNICATION NETWORKS, 2019, 2019
  • [37] ALL-IN-ONE DROPLET PLATFORM FOR MULTIPLEXED GENETIC DETECTION IN BLOOD
    Zhang, Yi
    Wang, Tza-Huei
    26TH IEEE INTERNATIONAL CONFERENCE ON MICRO ELECTRO MECHANICAL SYSTEMS (MEMS 2013), 2013, : 1061 - 1064
  • [38] All in One Bad Weather Removal using Architectural Search
    Li, Ruoteng
    Tan, Robby T.
    Cheong, Loong-Fah
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3172 - 3182
  • [39] All-in-one droplet analysis
    Askey, Sue
    CHEMISTRY WORLD, 2006, 3 (03): : 29 - 29
  • [40] All-In-One Reliability Approach
    Hegde, Vinayak
    2022 68TH ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM (RAMS 2022), 2022,