Boosting Online 3D Multi-Object Tracking through Camera-Radar Cross Check

被引:0
|
作者
Kuan, Sheng-Yao [1 ]
Cheng, Jen-Hao [2 ]
Huang, Hsiang-Wei [2 ]
Chai, Wenhao [2 ]
Yang, Cheng-Yen [2 ]
Latapie, Hugo [3 ]
Liu, Gaowen [3 ]
Wu, Bing-Fei [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Hsinchu, Taiwan
[2] Univ Washington, Seattle, WA USA
[3] Cisco, San Jose, CA USA
关键词
OBJECT DETECTION;
D O I
10.1109/IV55156.2024.10588514
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-art single-modality detectors through sensor fusion remains an active challenge. This work leverages the respective advantages of cameras in perspective view and radars in Bird's Eye View (BEV) to greatly enhance overall detection and tracking performance. Our approach, Camera-Radar Associated Fusion Tracking Booster (CRAFTBooster) represents a pioneering effort to enhance radar-camera fusion in the tracking stage, contributing to improved 3D MOT accuracy. The superior experimental results on K-Radaar dataset, which exhibit 5-6% on IDF1 tracking performance gain, validate the potential of effective sensor fusion in advancing autonomous driving.
引用
收藏
页码:2125 / 2132
页数:8
相关论文
共 50 条
  • [1] 3D Multi-Object Tracking Based on Radar-Camera Fusion
    Lin, Zihao
    Hu, Jianming
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2502 - 2507
  • [2] Optimization based 3D Multi-Object Tracking using Camera and Radar Data
    Poeschmann, Johannes
    Pfeifer, Tim
    Protzel, Peter
    2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 1116 - 1123
  • [3] CFTrack: Center-based Radar and Camera Fusion for 3D Multi-Object Tracking
    Nabati, Ramin
    Harris, Landon
    Qi, Hairong
    2021 IEEE INTELLIGENT VEHICLES SYMPOSIUM WORKSHOPS (IV WORKSHOPS), 2021, : 243 - 248
  • [4] Detection-by-Tracking Boosted Online 3D Multi-Object Tracking
    Chen, Quei-An
    Tsukada, Akihiro
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 295 - 301
  • [5] CaRA-MOT: 3D Multi-Object Tracking with Memory Mechanism using Camera and Radar
    Lee, Min Young
    Ang, Marcelo H., Jr.
    2024 10TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTIC, ICCAR 2024, 2024, : 334 - 339
  • [6] Learnable Online Graph Representations for 3D Multi-Object Tracking
    Zaech, Jan-Nico
    Liniger, Alexander
    Dai, Dengxin
    Danelljan, Martin
    Van Gool, Luc
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 5103 - 5110
  • [7] Camera-Radar Fusion with Modality Interaction and Radar Gaussian Expansion for 3D Object Detection
    Liu, Xiang
    Li, Zhenglin
    Zhou, Yang
    Peng, Yan
    Luo, Jun
    CYBORG AND BIONIC SYSTEMS, 2024, 5
  • [8] Wildlife 3D multi-object tracking
    Klasen, Morris
    Steinhage, Volker
    ECOLOGICAL INFORMATICS, 2022, 71
  • [9] Online Multi-Object Tracking With Visual and Radar Features
    Bae, Seung-Hwan
    IEEE ACCESS, 2020, 8 (08): : 90324 - 90339
  • [10] 3DMOTFormer: Graph Transformer for Online 3D Multi-Object Tracking
    Ding, Shuxiao
    Rehder, Eike
    Schneider, Lukas
    Cordts, Marius
    Gall, Juergen
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 9750 - 9760