Design and Implementation of a Radar-Camera Fusion System for Human Detection and Its Distance Measurement

被引:0
|
作者
Mahayuda, Indra Putra [1 ]
Pratama, Allan Rizaldy [2 ]
Dewantara, Bima Sena Bayu [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politekn Elekt Negeri Surabaya, Dept Informat & Comp Engn, Surabaya, Indonesia
[2] Univ Pembangunan Nasl Vet Jawa Timur, Fac Comp Sci, Data Sci Dept, Surabaya, Indonesia
关键词
Human Distance Detection; Sensor Fusion; Radar-Camera System; Instance Segmentation; Coordinate Transformation; TRACKING;
D O I
10.1109/IES63037.2024.10665849
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human distance detection is essential for improving safety and efficiency in applications such as autonomous vehicles, surveillance, and human-robot interaction. Integrating radar and camera data through sensor fusion significantly improves detection accuracy and reliability while reducing the inherent limitations of each sensor type. This research presents the design of a radar-camera fusion system that reads and processes data from both sources. Instance segmentation is used to identify objects for camera data, while radar data is projected to pixel coordinates through coordinate transformation, allowing the two data sets to be fused into the same space. This fusion results in more complete object information. The developed system achieved 100% object detection accuracy in the experimental scenario and demonstrated 93.4% distance measurement accuracy, with average longitudinal and latitudinal errors of 37.1 cm and 17.5 cm, respectively.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [21] Integrated radar-camera security system - range test
    Zyczkowski, M.
    Szustakowski, M.
    Ciurapinski, W.
    Karol, M.
    Markowski, P.
    RADAR SENSOR TECHNOLOGY XVI, 2012, 8361
  • [22] Radar-Camera Fusion Network for Depth Estimation in Structured Driving Scenes
    Li, Shuguang
    Yan, Jiafu
    Chen, Haoran
    Zheng, Ke
    SENSORS, 2023, 23 (17)
  • [23] Robust Multiobject Tracking Using Mmwave Radar-Camera Sensor Fusion
    Sengupta, Arindam
    Cheng, Lei
    Cao, Siyang
    IEEE SENSORS LETTERS, 2022, 6 (10)
  • [24] RCF-TP: Radar-Camera Fusion With Temporal Priors for 3D Object Detection
    Miron, Yakov
    Drews, Florian
    Faion, Florian
    Di Castro, Dotan
    Klein, Itzik
    IEEE ACCESS, 2024, 12 : 127212 - 127223
  • [25] Automatic Radar-Camera Dataset Generation for Sensor-Fusion Applications
    Sengupta, Arindam
    Yoshizawa, Atsushi
    Cao, Siyang
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 2875 - 2882
  • [26] Improving Radar-Camera Fusion-based 3D Object Detection for Autonomous Vehicles
    Kurniawan, Irfan Tito
    Trilaksono, Bambang Riyanto
    2022 12TH INTERNATIONAL CONFERENCE ON SYSTEM ENGINEERING AND TECHNOLOGY (ICSET 2022), 2022, : 42 - 47
  • [27] Integrated radar-camera security system - experimental results.
    Zyczkowski, M.
    Palka, N.
    Trzcinski, T.
    Dulski, R.
    Kastek, M.
    Trzaskawka, P.
    RADAR SENSOR TECHNOLOGY XV, 2011, 8021
  • [28] Integrated mobile radar-camera system in airport perimeter security
    Zyczkowski, M.
    Szustakowski, M.
    Ciurapinski, W.
    Dulski, R.
    Kastek, M.
    Trzaskawka, P.
    UNMANNED/UNATTENDED SENSORS AND SENSOR NETWORKS VIII, 2011, 8184
  • [29] MMW-Carry: Enhancing Carry Object Detection Through Millimeter-Wave Radar-Camera Fusion
    Gao, Xiangyu
    Luo, Youchen
    Alansari, Ali
    Sun, Yaping
    IEEE SENSORS JOURNAL, 2024, 24 (09) : 15091 - 15100
  • [30] RCRFNet: Enhancing Object Detection with Self-Supervised Radar-Camera Fusion and Open-Set Recognition
    Chen, Minwei
    Liu, Yajun
    Zhang, Zenghui
    Guo, Weiwei
    SENSORS, 2024, 24 (15)