CMD: A Cross Mechanism Domain Adaptation Dataset for 3D Object Detection

被引:1
|
作者
Deng, Jinhao [1 ,2 ]
Ye, Wei [1 ,2 ]
Wu, Hai [1 ,2 ]
Huang, Xun [1 ,2 ]
Xia, Qiming [1 ,2 ]
Li, Xin [4 ]
Fang, Jin [3 ]
Li, Wei [3 ]
Wen, Chenglu [1 ,2 ]
Wang, Cheng [1 ,2 ]
机构
[1] Xiamen Univ, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen, Peoples R China
[2] Xiamen Univ, Key Lab Multimedia Trusted Percept & Efficient Co, Minist Educ China, Xiamen, Peoples R China
[3] Inceptio, Shanghai, Peoples R China
[4] Texas A&M Univ, Sect Visual Comp & Interact Media, College Stn, TX USA
来源
关键词
Dataset; 3D Object Detection; Domain Adaptation;
D O I
10.1007/978-3-031-72998-0_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud data, representing the precise 3D layout of the scene, quickly drives the research of 3D object detection. However, the challenge arises due to the rapid iteration of 3D sensors, which leads to significantly different distributions in point clouds. This, in turn, results in subpar performance of 3D cross-sensor object detection. This paper introduces a Cross Mechanism Dataset, named CMD, to support research tackling this challenge. CMD is the first domain adaptation dataset, comprehensively encompassing diverse mechanical sensors and various scenes for 3D object detection. In terms of sensors, CMD includes 32-beam LiDAR, 128-beam LiDAR, solid-state LiDAR, 4D millimeter-wave radar, and cameras, all of which are well-synchronized and calibrated. Regarding the scenes, CMD consists of 50 sequences collocated from different scenarios, ranging from campuses to highways. Furthermore, we validated the effectiveness of various domain adaptation methods in mitigating sensor-based domain differences. We also proposed a DIG method to reduce domain disparities from the perspectives of Density, Intensity, and Geometry, which effectively bridges the domain gap between different sensors. The experimental results on the CMD dataset show that our proposed DIG method outperforms the state-of-the-art techniques, demonstrating the effectiveness of our baseline method. The dataset and the corresponding code are available at https://github.com/im-djh/CMD.
引用
收藏
页码:219 / 236
页数:18
相关论文
共 50 条
  • [1] Pseudo Label Refinery for Unsupervised Domain Adaptation on Cross-dataset 3D Object Detection
    Zhang, Zhanwei
    Chen, Minghao
    Xiao, Shuai
    Peng, Liang
    la Li, Hen
    Lin, Binbin
    Li, Ping
    Wang, Wenxiao
    Wu, Boxi
    Cai, Deng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 15291 - 15300
  • [2] SRDAN: Scale-aware and Range-aware Domain Adaptation Network for Cross-dataset 3D Object Detection
    Zhang, Weichen
    Li, Wen
    Xu, Dong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6765 - 6775
  • [3] CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection
    Chang, Gyusam
    Roh, Wonseok
    Jang, Sujin
    Lee, Dongwook
    Ji, Daehyun
    Oh, Gyeongrok
    Park, Jinsun
    Kim, Jinkyu
    Kim, Sangpil
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 972 - 980
  • [4] Unsupervised Domain Adaptation for 3D Object Detection via Self-Training
    Luo, Di
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 307 - 318
  • [5] ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
    Yang, Jihan
    Shi, Shaoshuai
    Wang, Zhe
    Li, Hongsheng
    Qi, Xiaojuan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10363 - 10373
  • [6] MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detection
    Tsai, Darren
    Berrio, Julie Stephany
    Shan, Mao
    Nebot, Eduardo
    Worrall, Stewart
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 140 - 147
  • [7] 3D Object Detection on large-scale dataset
    Zhao, Yan
    Zhu, Jihong
    Liang, Haoyu
    Chen, Lyujie
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [8] Range Adaptation for 3D Object Detection in LiDAR
    Wang, Ze
    Ding, Sihao
    Li, Ying
    Zhao, Minming
    Roychowdhury, Sohini
    Wallin, Andreas
    Sapiro, Guillermo
    Qiu, Qiang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2320 - 2328
  • [9] CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detection
    Peng, Xidong
    Zhu, Xinge
    Ma, Yuexin
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 2047 - 2055
  • [10] LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection
    Fang, Jin
    Zhou, Dingfu
    Zhao, Jingjing
    Wu, Chenming
    Tang, Chulin
    Xu, Cheng-Zhong
    Zhang, Liangjun
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 14822 - 14829