Diffusion Models-Based Purification for Common Corruptions on Robust 3D Object Detection

被引:2
|
作者
Cai, Mumuxin [1 ]
Wang, Xupeng [2 ]
Sohel, Ferdous [3 ]
Lei, Hang [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Software Engn, Chengdu 610054, Peoples R China
[2] Univ Elect Sci & Technol, Lab Intelligent Collaborat Comp, Chengdu 610054, Peoples R China
[3] Murdoch Univ, Sch Informat Technol, Perth, WA 6150, Australia
基金
中国国家自然科学基金;
关键词
3D object detection; LiDAR scene data; point cloud; diffusion models; defence strategy; adversarial robustness;
D O I
10.3390/s24165440
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
LiDAR sensors have been shown to generate data with various common corruptions, which seriously affect their applications in 3D vision tasks, particularly object detection. At the same time, it has been demonstrated that traditional defense strategies, including adversarial training, are prone to suffering from gradient confusion during training. Moreover, they can only improve their robustness against specific types of data corruption. In this work, we propose LiDARPure, which leverages the powerful generation ability of diffusion models to purify corruption in the LiDAR scene data. By dividing the entire scene into voxels to facilitate the processes of diffusion and reverse diffusion, LiDARPure overcomes challenges induced from adversarial training, such as sparse point clouds in large-scale LiDAR data and gradient confusion. In addition, we utilize the latent geometric features of a scene as a condition to assist the generation of diffusion models. Detailed experiments show that LiDARPure can effectively purify 19 common types of LiDAR data corruption. Further evaluation results demonstrate that it can improve the average precision of 3D object detectors to an extent of 20% in the face of data corruption, much higher than existing defence strategies.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Driving
    Dong, Yinpeng
    Kang, Caixin
    Zhang, Jinlai
    Zhu, Zijian
    Wang, Yikai
    Yang, Xiao
    Su, Hang
    Wei, Xingxing
    Zhu, Jun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1022 - 1032
  • [2] 3D Common Corruptions and Data Augmentation
    Kar, Oguzhan Fatih
    Yeo, Teresa
    Atanov, Andrei
    Zamir, Amir
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18941 - 18952
  • [3] A robust 3D unique descriptor for 3D object detection
    Joshi, Piyush
    Rastegarpanah, Alireza
    Stolkin, Rustam
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (03)
  • [4] Robust 3D Object Detection for Moving Objects Based on PointPillars
    Nakamura, Ryota
    Enokida, Shuichi
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 611 - 617
  • [5] Diffusion-Based 3D Object Detection with Random Boxes
    Zhou, Xin
    Hou, Jinghua
    Yao, Tingting
    Liang, Dingkang
    Liu, Zhe
    Zou, Zhikang
    Ye, Xiaoqing
    Cheng, Jianwei
    Bai, Xiang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 28 - 40
  • [6] Hidden Markov models-based 3D MRI brain segmentation
    Ibrahim, M.
    John, N.
    Kabuka, M.
    Younis, A.
    IMAGE AND VISION COMPUTING, 2006, 24 (10) : 1065 - 1079
  • [7] Improvements of 3D object detection with part-based models
    Lu, Wen-Hao
    Li, Ya-Li
    Wang, Sheng-Jin
    Ding, Xiao-Qing
    Zidonghua Xuebao/Acta Automatica Sinica, 2012, 38 (04): : 497 - 506
  • [8] Dense Point Diffusion for 3D Object Detection
    Liu, Xu
    Cao, Jiayan
    Bi, Qianqian
    Wang, Jian
    Shi, Boxin
    Wei, Yichen
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 762 - 770
  • [9] RoarNet: A Robust 3D Object Detection based on RegiOn Approximation Refinement
    Shin, Kiwoo
    Kwon, Youngwook Paul
    Tomizuka, Masayoshi
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 2510 - 2515
  • [10] MonoWAD: Weather-Adaptive Diffusion Model for Robust Monocular 3D Object Detection
    Oh, Youngmin
    Kim, Hyung-Il
    Kim, Seong Tae
    Kim, Jung Uk
    COMPUTER VISION - ECCV 2024, PT X, 2025, 15068 : 326 - 345