Boosting Online 3D Multi-Object Tracking through Camera-Radar Cross Check

被引:0
|
作者
Kuan, Sheng-Yao [1 ]
Cheng, Jen-Hao [2 ]
Huang, Hsiang-Wei [2 ]
Chai, Wenhao [2 ]
Yang, Cheng-Yen [2 ]
Latapie, Hugo [3 ]
Liu, Gaowen [3 ]
Wu, Bing-Fei [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Hsinchu, Taiwan
[2] Univ Washington, Seattle, WA USA
[3] Cisco, San Jose, CA USA
关键词
OBJECT DETECTION;
D O I
10.1109/IV55156.2024.10588514
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-art single-modality detectors through sensor fusion remains an active challenge. This work leverages the respective advantages of cameras in perspective view and radars in Bird's Eye View (BEV) to greatly enhance overall detection and tracking performance. Our approach, Camera-Radar Associated Fusion Tracking Booster (CRAFTBooster) represents a pioneering effort to enhance radar-camera fusion in the tracking stage, contributing to improved 3D MOT accuracy. The superior experimental results on K-Radaar dataset, which exhibit 5-6% on IDF1 tracking performance gain, validate the potential of effective sensor fusion in advancing autonomous driving.
引用
收藏
页码:2125 / 2132
页数:8
相关论文
共 50 条
  • [21] 3D Multi-Object Tracking: A Baseline and New Evaluation Metrics
    Weng, Xinshuo
    Wang, Jianren
    Held, David
    Kitani, Kris
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10359 - 10366
  • [22] Camera-Radar Fusion with Modality Interaction and Radar Gaussian Expansion for 3D Detection
    Liu, Xiang
    Li, Zhenglin
    Zhou, Yang
    Peng, Yan
    Luo, Jun
    Liu, Xiang
    CYBORG AND BIONIC SYSTEMS, 2024, 5
  • [23] EagerMOT: 3D Multi-Object Tracking via Sensor Fusion
    Kim, Aleksandr
    Osep, Aljosa
    Leal-Taixe, Laura
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11315 - 11321
  • [24] A 3D Multi-Object Tracking Based on Bounding Box and Depth
    Feng, Chun-Hao
    Chang, Jen-Yuan
    PROCEEDINGS OF THE ASME 2021 30TH CONFERENCE ON INFORMATION STORAGE AND PROCESSING SYSTEMS (ISPS2021), 2021,
  • [25] Multi-Object tracking of 3D cuboids using aggregated features
    Muresan, Mircea Paul
    Nedevschi, Sergiu
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING (ICCP 2019), 2019, : 11 - 18
  • [26] FANTrack: 3D Multi-Object Tracking with Feature Association Network
    Baser, Erkan
    Balasubramanian, Venkateshwaran
    Bhattacharyya, Prarthana
    Czarnecki, Krzysztof
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1426 - 1433
  • [27] Exploring Simple 3D Multi-Object Tracking for Autonomous Driving
    Luo, Chenxu
    Yang, Xiaodong
    Yuille, Alan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 10468 - 10477
  • [28] Mono-Camera 3D Multi-Object Tracking Using Deep Learning Detections and PMBM Filtering
    Scheidegger, Samuel
    Benjaminsson, Joachim
    Rosenberg, Emil
    Krishnan, Amrit
    Granstrom, Karl
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 433 - 440
  • [29] DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion With Deep Association
    Wang, Xiyang
    Fu, Chunyun
    Li, Zhankun
    Lai, Ying
    He, Jiawei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03): : 8260 - 8267
  • [30] A Multi-Level Eigenvalue Fusion Algorithm for 3D Multi-Object Tracking
    Liu, Hantao
    Hu, Jianming
    Li, Xingyu
    Peng, Lihui
    INTERNATIONAL CONFERENCE ON TRANSPORTATION AND DEVELOPMENT 2022: APPLICATION OF EMERGING TECHNOLOGIES, 2022, : 235 - 245