Design and Implementation of a Radar-Camera Fusion System for Human Detection and Its Distance Measurement

被引:0
|
作者
Mahayuda, Indra Putra [1 ]
Pratama, Allan Rizaldy [2 ]
Dewantara, Bima Sena Bayu [1 ]
Pramadihanto, Dadet [1 ]
机构
[1] Politekn Elekt Negeri Surabaya, Dept Informat & Comp Engn, Surabaya, Indonesia
[2] Univ Pembangunan Nasl Vet Jawa Timur, Fac Comp Sci, Data Sci Dept, Surabaya, Indonesia
关键词
Human Distance Detection; Sensor Fusion; Radar-Camera System; Instance Segmentation; Coordinate Transformation; TRACKING;
D O I
10.1109/IES63037.2024.10665849
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Human distance detection is essential for improving safety and efficiency in applications such as autonomous vehicles, surveillance, and human-robot interaction. Integrating radar and camera data through sensor fusion significantly improves detection accuracy and reliability while reducing the inherent limitations of each sensor type. This research presents the design of a radar-camera fusion system that reads and processes data from both sources. Instance segmentation is used to identify objects for camera data, while radar data is projected to pixel coordinates through coordinate transformation, allowing the two data sets to be fused into the same space. This fusion results in more complete object information. The developed system achieved 100% object detection accuracy in the experimental scenario and demonstrated 93.4% distance measurement accuracy, with average longitudinal and latitudinal errors of 37.1 cm and 17.5 cm, respectively.
引用
收藏
页码:486 / 490
页数:5
相关论文
共 50 条
  • [41] A Novel Spatio-Temporal Synchronization Method of Roadside Asynchronous MMW Radar-Camera for Sensor Fusion
    Du, Yuchuan
    Qin, Bohao
    Zhao, Cong
    Zhu, Yifan
    Cao, Jing
    Ji, Yuxiong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 22278 - 22289
  • [42] RC-BEVFusion: A Plug-In Module for Radar-Camera Bird's Eye View Feature Fusion
    Staecker, Lukas
    Mishra, Shashank
    Heidenreich, Philipp
    Rambach, Jason
    Stricker, Didier
    PATTERN RECOGNITION, DAGM GCPR 2023, 2024, 14264 : 178 - 194
  • [43] TL-4DRCF: A Two-Level 4-D Radar-Camera Fusion Method for Object Detection in Adverse Weather
    Zhang, Haoyi
    Wu, Kai
    Chen, Rongkang
    Wu, Zihao
    Zhong, Yong
    Li, Weihua
    IEEE SENSORS JOURNAL, 2024, 24 (10) : 16408 - 16418
  • [44] Radar and Camera Fusion for Vacant Parking Space Detection
    Wu, Bo-Xun
    Lin, Jia-Jheng
    Kuo, Hsien-Kai
    Chen, Po-Yu
    Guo, Jiun-In
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, : 242 - 245
  • [45] Design and Implementation of Online Detection System of Radar Servo Motor
    Sun, Yongjiang
    Yang, YongFeng
    Liu, Jun
    Lu, Xinglong
    Jin, Huasong
    Yu, Jiancheng
    INTERNATIONAL CONFERENCE ON CONTROL SYSTEM AND AUTOMATION (CSA 2013), 2013, : 358 - 362
  • [46] Blind Spot Detection System in Vehicles Using Fusion of Radar Detections and Camera Verification
    Shayan Shirahmad Gale Bagi
    Behzad Moshiri
    Hossein Gharaee Garakani
    Mohammad Khoshnevisan
    International Journal of Intelligent Transportation Systems Research, 2021, 19 : 389 - 404
  • [47] Blind Spot Detection System in Vehicles Using Fusion of Radar Detections and Camera Verification
    Shirahmad Gale Bagi, Shayan
    Moshiri, Behzad
    Gharaee Garakani, Hossein
    Khoshnevisan, Mohammad
    INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2021, 19 (02) : 389 - 404
  • [48] Design and Implementation of an Antenna Measurement System for the Mono-Pulse Radar
    Song Li-zhong
    Mu Yi-nan
    Qiao Xiao-lin
    Wu Qun
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 2865 - 2868
  • [49] Design and Implementation of Human Detection Feature on Surveillance Embedded IP Camera
    Yuwono, Widodo Setyo
    Sudiharto, Dodi Wisaksono
    Wijiutomo, Catur Wirawan
    PROCEEDINGS OF 2018 3RD INTERNATIONAL CONFERENCE ON SUSTAINABLE INFORMATION ENGINEERING AND TECHNOLOGY (SIET 2018), 2018, : 42 - 47
  • [50] Remote radar-camera vital sign monitoring system using a graph-based extraction algorithm
    Yang, Xingyu
    Zhang, Zijian
    Li, Xinhua
    Zheng, Yalin
    Shen, Yaochun
    2021 46TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER AND TERAHERTZ WAVES (IRMMW-THZ), 2021,