CMD: A Cross Mechanism Domain Adaptation Dataset for 3D Object Detection

被引:1
|
作者
Deng, Jinhao [1 ,2 ]
Ye, Wei [1 ,2 ]
Wu, Hai [1 ,2 ]
Huang, Xun [1 ,2 ]
Xia, Qiming [1 ,2 ]
Li, Xin [4 ]
Fang, Jin [3 ]
Li, Wei [3 ]
Wen, Chenglu [1 ,2 ]
Wang, Cheng [1 ,2 ]
机构
[1] Xiamen Univ, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen, Peoples R China
[2] Xiamen Univ, Key Lab Multimedia Trusted Percept & Efficient Co, Minist Educ China, Xiamen, Peoples R China
[3] Inceptio, Shanghai, Peoples R China
[4] Texas A&M Univ, Sect Visual Comp & Interact Media, College Stn, TX USA
来源
关键词
Dataset; 3D Object Detection; Domain Adaptation;
D O I
10.1007/978-3-031-72998-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud data, representing the precise 3D layout of the scene, quickly drives the research of 3D object detection. However, the challenge arises due to the rapid iteration of 3D sensors, which leads to significantly different distributions in point clouds. This, in turn, results in subpar performance of 3D cross-sensor object detection. This paper introduces a Cross Mechanism Dataset, named CMD, to support research tackling this challenge. CMD is the first domain adaptation dataset, comprehensively encompassing diverse mechanical sensors and various scenes for 3D object detection. In terms of sensors, CMD includes 32-beam LiDAR, 128-beam LiDAR, solid-state LiDAR, 4D millimeter-wave radar, and cameras, all of which are well-synchronized and calibrated. Regarding the scenes, CMD consists of 50 sequences collocated from different scenarios, ranging from campuses to highways. Furthermore, we validated the effectiveness of various domain adaptation methods in mitigating sensor-based domain differences. We also proposed a DIG method to reduce domain disparities from the perspectives of Density, Intensity, and Geometry, which effectively bridges the domain gap between different sensors. The experimental results on the CMD dataset show that our proposed DIG method outperforms the state-of-the-art techniques, demonstrating the effectiveness of our baseline method. The dataset and the corresponding code are available at https://github.com/im-djh/CMD.
引用
收藏
页码:219 / 236
页数:18
相关论文
共 50 条
  • [21] FANet: Improving 3D Object Detection with Position Adaptation
    Ye, Jian
    Zuo, Fushan
    Qian, Yuqing
    APPLIED SCIENCES-BASEL, 2023, 13 (13):
  • [22] PLS: UNSUPERVISED DOMAIN ADAPTATION FOR 3D OBJECT DETECTION VIA PSEUDO-LABEL SIZES
    Chen, Shijie
    Wang, Rongquan
    Li, Xin
    Wu, Yuchen
    Liu, Haizhuang
    Chen, Jiansheng
    Ma, Huimin
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6370 - 6374
  • [23] Gradual Batch Alternation for Effective Domain Adaptation in LiDAR-Based 3D Object Detection
    Rochan, Mrigank
    Chen, Xingxin
    Grandhi, Alaap
    Corral-Soto, Eduardo R.
    Liu, Bingbing
    2024 35TH IEEE INTELLIGENT VEHICLES SYMPOSIUM, IEEE IV 2024, 2024, : 2213 - 2219
  • [24] Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection in Self-Driving Cars
    You, Yurong
    Diaz-Ruiz, Carlos Andres
    Wang, Yan
    Chao, Wei-Lun
    Hariharan, Bharath
    Campbell, Mark
    Weinbergert, Kilian Q.
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 5070 - 5077
  • [25] SSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from Point Cloud
    Wang, Yan
    Yin, Junbo
    Li, Wei
    Frossard, Pascal
    Yang, Ruigang
    Shen, Jianbing
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 2707 - 2715
  • [26] Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimation
    Tremblay, Jonathan
    To, Thang
    Birchfield, Stan
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 2119 - 2122
  • [27] Automotive Radar Dataset for Deep Learning Based 3D Object Detection
    Meyer, Michael
    Kuschk, Georg
    2019 16TH EUROPEAN RADAR CONFERENCE (EURAD), 2019, : 129 - 132
  • [28] Uni3DA: Universal 3D Domain Adaptation for Object Recognition
    Ren, Yu
    Cong, Yang
    Dong, Jiahua
    Sun, Gan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 379 - 392
  • [29] MA-ST3D: Motion Associated Self-Training for Unsupervised Domain Adaptation on 3D Object Detection
    Zhang, Chi
    Chen, Wenbo
    Wang, Wei
    Zhang, Zhaoxiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6227 - 6240
  • [30] SCAN: Cross Domain Object Detection with Semantic Conditioned Adaptation
    Li, Wuyang
    Liu, Xinyu
    Yao, Xiwen
    Yuan, Yixuan
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1421 - 1428