Design and Implementation of a Radar-Camera Fusion System for Human Detection and Its Distance Measurement

被引:0
|
作者
Mahayuda, Indra Putra [1 ]
Pratama, Allan Rizaldy [2 ]
Dewantara, Bima Sena Bayu [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politekn Elekt Negeri Surabaya, Dept Informat & Comp Engn, Surabaya, Indonesia
[2] Univ Pembangunan Nasl Vet Jawa Timur, Fac Comp Sci, Data Sci Dept, Surabaya, Indonesia
关键词
Human Distance Detection; Sensor Fusion; Radar-Camera System; Instance Segmentation; Coordinate Transformation; TRACKING;
D O I
10.1109/IES63037.2024.10665849
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human distance detection is essential for improving safety and efficiency in applications such as autonomous vehicles, surveillance, and human-robot interaction. Integrating radar and camera data through sensor fusion significantly improves detection accuracy and reliability while reducing the inherent limitations of each sensor type. This research presents the design of a radar-camera fusion system that reads and processes data from both sources. Instance segmentation is used to identify objects for camera data, while radar data is projected to pixel coordinates through coordinate transformation, allowing the two data sets to be fused into the same space. This fusion results in more complete object information. The developed system achieved 100% object detection accuracy in the experimental scenario and demonstrated 93.4% distance measurement accuracy, with average longitudinal and latitudinal errors of 37.1 cm and 17.5 cm, respectively.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [11] An Asymmetric Radar-Camera Fusion Framework for Autonomous Driving
    Su, Zhiyi
    Ming, Binbin
    Hua, Wei
    2023 IEEE SENSORS, 2023,
  • [12] Fusion Point Pruning for Optimized 2D Object Detection with Radar-Camera Fusion
    Staecker, Lukas
    Heidenreich, Philipp
    Rambach, Jason
    Stricker, Didier
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1275 - 1282
  • [13] Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
    Yao, Shanliang
    Guan, Runwei
    Huang, Xiaoyu
    Li, Zhuoxiao
    Sha, Xiangyu
    Yue, Yong
    Lim, Eng Gee
    Seo, Hyungjoon
    Man, Ka Lok
    Zhu, Xiaohui
    Yue, Yutao
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2094 - 2128
  • [14] RCBEVD: Radar-Camera Fusion in Bird's Eye View for Detection with Velocity Estimation
    Jia, Yansong
    Lee, Christina Dao Wen
    Ang, Marcelo H., Jr.
    INTELLIGENT AUTONOMOUS SYSTEMS 18, VOL 1, IAS18-2023, 2024, 795 : 43 - 55
  • [15] Fusion Technology of Radar and RGB Camera Sensors for Object Detection and Tracking and its Embedded System Implementation
    Lu, Jian Xian
    Lin, Jia Cheng
    Vinay, M. S.
    Chen, Po-Yu
    Guo, Jiun-In
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1234 - 1242
  • [16] Semantics-Fusion: Radar Semantic Information-Based Radar-Camera Fusion for 3D Object Detection
    Tian, Ziran
    Huang, Xiaohong
    Xu, Kunqiang
    Sun, Xujie
    Deng, Zhenmiao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (14)
  • [17] FARFusion: A Practical Roadside Radar-Camera Fusion System for Far-Range Perception
    Li, Yao
    Wang, Yingjie
    Meng, Chengzhen
    Duan, Yifan
    Ji, Jianmin
    Zhang, Yu
    Zhang, Yanyong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06) : 5433 - 5440
  • [18] Learning to Analyze Human Skeletal by Radar-Camera Supervision
    Jiang, Ziyi
    Ke, Feng
    Kang, Wenyuan
    Zhai, Yikui
    Zhang, Qian
    Zhang, Xiu Yin
    Xu, Xiangmin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [19] LRCFormer: lightweight transformer based radar-camera fusion for 3D target detection
    Huang, Xiaohong
    Xu, Kunqiang
    Tian, Ziran
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [20] RCM-Fusion: Radar-Camera Multi-Level Fusion for 3D Object Detection
    Kim, Jisong
    Seong, Minjae
    Bang, Geonho
    Kum, Dongsuk
    Choi, Jun Won
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 18236 - 18242