Rethinking all-in-one adverse weather removal for object detection

被引:0
|
作者
Li, Yufeng [1 ]
Chen, Jiayu [1 ]
Xie, Chuanlong [1 ]
Chen, Hongming [1 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect Informat Engn, Shenyang 110136, Peoples R China
关键词
All-in-one image restoration; Adverse weather; Object detection; Prompt learning; Vision MLP;
D O I
10.1007/s11760-024-03493-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Despite significant progress has been made in image restoration under adverse weather conditions, these methods primarily focus on the quality of image reconstruction, leaving their impact on downstream object detection unknown. In this paper, we rethink all-in-one adverse weather removal for object detection. Specifically, we contribute the first multi-weather image restoration dataset tailored for autonomous driving scenarios, comprising 6000 image pairs along with object detection labels, named Multi-Weather6k. Based on this dataset, we conduct a benchmark study on existing methods for joint image restoration and object detection. Furthermore, we develop an effective MLP-based all-in-one image de-weathering framework to better solve this task. The proposed architecture consists of the feature mixing block and the feature prompt block. The former enhances feature modeling by exploiting global and local correlations, while the latter guides image restoration by modulating multi-degraded features using prompt learning. Experimental results show that our proposed method not only achieves consistently superior restoration performance across various weather degradation scenarios but also yields improved object detection results, outperforming the state-of-the-art approaches. The dataset will be available to the public.
引用
收藏
页码:8597 / 8606
页数:10
相关论文
共 50 条
  • [1] Continual All-in-One Adverse Weather Removal With Knowledge Replay on a Unified Network Structure
    Cheng, De
    Ji, Yanling
    Gong, Dong
    Li, Yan
    Wang, Nannan
    Han, Junwei
    Zhang, Dingwen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8184 - 8196
  • [2] Image all-in-one adverse weather removal via dynamic model weights generation
    Wan, Yecong
    Shao, Mingwen
    Cheng, Yuanshuo
    Zuo, Wangmeng
    KNOWLEDGE-BASED SYSTEMS, 2024, 302
  • [3] Rethinking LiDAR Object Detection in adverse weather conditions
    Vattem, Teja
    Sebastian, George
    Lukic, Luka
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 5093 - 5099
  • [4] Always Clear Days: Degradation Type and Severity Aware All-in-One Adverse Weather Removal
    Chen, Yu-Wei
    Pei, Soo-Chang
    IEEE ACCESS, 2025, 13 : 7650 - 7662
  • [5] All-In-One Image Restoration in Adverse Weather Conditions with Spatial-Frequency Domain Information
    Jing, Panfeng
    Liang, Yudong
    Wang, Siyu
    Gao, Pin
    An, Hongqiang
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2024, PT II, 2025, 15202 : 418 - 432
  • [6] All-in-one gene detection on a chip
    Hadlington, Simon
    CHEMISTRY WORLD, 2008, 5 (06): : 23 - 23
  • [7] Performance of the ATMOS41 All-in-One Weather Station for Weather Monitoring
    Dombrowski, Olga
    Hendricks Franssen, Harrie-Jan
    Brogi, Cosimo
    Bogena, Heye Reemt
    SENSORS, 2021, 21 (03) : 1 - 23
  • [8] ALL-IN-ONE NETWORK FOR NLOS MM-WAVE RADAR OBJECT DETECTION BASED ON TRANSFORMER
    Chen, Zhiqiang
    Zhou, Yuetong
    Zhou, Zihan
    Sun, Bing
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 6141 - 6144
  • [9] Object detection in adverse weather condition for autonomous vehicles
    Emmanuel Owusu Appiah
    Solomon Mensah
    Multimedia Tools and Applications, 2024, 83 : 28235 - 28261
  • [10] Study of Filtering the Weather Adverse Effects to Object Detection
    Shtekhin, S.
    Karachev, D.
    Stadnik, A.
    PHYSICS OF PARTICLES AND NUCLEI, 2024, 55 (03) : 329 - 333