Design and Implementation of a Radar-Camera Fusion System for Human Detection and Its Distance Measurement

被引:0
|
作者
Mahayuda, Indra Putra [1 ]
Pratama, Allan Rizaldy [2 ]
Dewantara, Bima Sena Bayu [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politekn Elekt Negeri Surabaya, Dept Informat & Comp Engn, Surabaya, Indonesia
[2] Univ Pembangunan Nasl Vet Jawa Timur, Fac Comp Sci, Data Sci Dept, Surabaya, Indonesia
关键词
Human Distance Detection; Sensor Fusion; Radar-Camera System; Instance Segmentation; Coordinate Transformation; TRACKING;
D O I
10.1109/IES63037.2024.10665849
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human distance detection is essential for improving safety and efficiency in applications such as autonomous vehicles, surveillance, and human-robot interaction. Integrating radar and camera data through sensor fusion significantly improves detection accuracy and reliability while reducing the inherent limitations of each sensor type. This research presents the design of a radar-camera fusion system that reads and processes data from both sources. Instance segmentation is used to identify objects for camera data, while radar data is projected to pixel coordinates through coordinate transformation, allowing the two data sets to be fused into the same space. This fusion results in more complete object information. The developed system achieved 100% object detection accuracy in the experimental scenario and demonstrated 93.4% distance measurement accuracy, with average longitudinal and latitudinal errors of 37.1 cm and 17.5 cm, respectively.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [31] 3D Multi-Object Tracking Based on Radar-Camera Fusion
    Lin, Zihao
    Hu, Jianming
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2502 - 2507
  • [32] A Hybrid Radar-Camera Respiratory Monitoring System Based on an Impulse-Radio Ultrawideband Radar
    Yang, Chenxi
    Bruce, Brendan
    Liu, Xiaofan
    Gholami, Behnood
    Tavassolian, Negar
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 2646 - 2649
  • [33] An Interactive Multi Model prediction-based Radar-Camera Fusion Algorithm for Autonomous Vehicles
    Luo, Jinpeng
    Xie, Hui
    Song, Kang
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 5569 - 5576
  • [34] Traffic flow digital twin generation for highway scenario based on radar-camera paired fusion
    Yanbing Li
    Weichuan Zhang
    Scientific Reports, 13 (1)
  • [35] Fast metric tracking by detection system: radar blob and camera fusion
    Alencar, Francisco A. R.
    Rosero, Luis Alberto
    Massera Filho, Carlos
    Osorio, Fernando S.
    Wolf, Denis F.
    2015 12TH LATIN AMERICAN ROBOTICS SYMPOSIUM AND 2015 3RD BRAZILIAN SYMPOSIUM ON ROBOTICS (LARS-SBR), 2015, : 120 - 124
  • [36] Traffic flow digital twin generation for highway scenario based on radar-camera paired fusion
    Li, Yanbing
    Zhang, Weichuan
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [37] 4D Radar-Camera Sensor Fusion for Robust Vehicle Pose Estimation in Foggy Environments
    Yang, Seunghoon
    Choi, Minseong
    Han, Seungho
    Choi, Keun-Ha
    Kim, Kyung-Soo
    IEEE Access, 2024, 12 : 16178 - 16188
  • [38] ClusterFusion: Leveraging Radar Spatial Features for Radar-Camera 3D Object Detection in Autonomous Vehicles
    Kurniawan, Irfan Tito
    Trilaksono, Bambang Riyanto
    IEEE ACCESS, 2023, 11 : 121511 - 121528
  • [39] A Hybrid Radar-Camera Sensing System With Phase Compensation for Random Body Movement Cancellation in Doppler Vital Sign Detection
    Gu, Changzhan
    Wang, Guochao
    Li, Yiran
    Inoue, Takao
    Li, Changzhi
    IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2013, 61 (12) : 4678 - 4688
  • [40] 4D Radar-Camera Sensor Fusion for Robust Vehicle Pose Estimation in Foggy Environments
    Yang, Seunghoon
    Choi, Minseong
    Han, Seungho
    Choi, Keun-Ha
    Kim, Kyung-Soo
    IEEE ACCESS, 2024, 12 : 16178 - 16188