Real-Time 3D Object Detection on Crowded Pedestrians

被引:0
|
作者
Lu, Bin [1 ,2 ]
Li, Qing [1 ]
Liang, Yanju [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Microelect, Beijing 100029, Peoples R China
[2] Wuxi IoT Innovat Ctr Co Ltd, Wuxi 214028, Peoples R China
关键词
attention; center alignment; heatmap; point sampling;
D O I
10.3390/s23218725
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of autonomous driving, object detection under point clouds is indispensable for environmental perception. In order to achieve the goal of reducing blind spots in perception, many autonomous driving schemes have added low-cost blind-filling LiDAR on the side of the vehicle. Unlike point cloud target detection based on high-performance LiDAR, the blind-filling LiDARs have low vertical angular resolution and are mounted on the side of the vehicle, resulting in easily mixed point clouds of pedestrian targets in close proximity to each other. These characteristics are harmful for target detection. Currently, many research works focus on target detection under high-density LiDAR. These methods cannot effectively deal with the high sparsity of the point clouds, and the recall and detection accuracy of crowded pedestrian targets tend to be low. To overcome these problems, we propose a real-time detection model for crowded pedestrian targets, namely RTCP. To improve computational efficiency, we utilize an attention-based point sampling method to reduce the redundancy of the point clouds, then we obtain new feature tensors by the quantization of the point cloud space and neighborhood fusion in polar coordinates. In order to make it easier for the model to focus on the center position of the target, we propose an object alignment attention module (OAA) for position alignment, and we utilize an additional branch of the targets' location occupied heatmap to guide the training of the OAA module. These methods improve the model's robustness against the occlusion of crowded pedestrian targets. Finally, we evaluate the detector on KITTI, JRDB, and our own blind-filling LiDAR dataset, and our algorithm achieved the best trade-off of detection accuracy against runtime efficiency.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Real-Time Multimodal 3D Object Detection with Transformers
    Liu, Hengsong
    Duan, Tongle
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (07):
  • [2] Real-time 3D Object Detection in Unstructured Environments
    Rui, Wang
    Ying, Liang
    PROCEEDINGS FIRST INTERNATIONAL CONFERENCE ON ELECTRONICS INSTRUMENTATION & INFORMATION SYSTEMS (EIIS 2017), 2017, : 183 - 188
  • [3] Real-Time 3D Object Detection and Recognition using a Smartphone
    Chen, Jin
    Zhu, Zhigang
    IMPROVE: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND VISION ENGINEERING, 2022, : 158 - 165
  • [4] REAL-TIME 3D OBJECT TRACKING
    STEPHENS, RS
    IMAGE AND VISION COMPUTING, 1990, 8 (01) : 91 - 96
  • [5] TR3D: TOWARDS REAL-TIME INDOOR 3D OBJECT DETECTION
    Rukhovich, Danila
    Vorontsova, Anna
    Konushin, Anton
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 281 - 285
  • [6] A 3D Convolutional Neural Network Towards Real-time Amodal 3D Object Detection
    Sun, Hao
    Meng, Zehui
    Du, Xinxin
    Ang, Marcelo H., Jr.
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 8331 - 8338
  • [7] An Approach to 3D Object Detection in Real-Time for Cognitive Robotics Experiments
    Vidal-Soroa, Daniel
    Furelos, Pedro
    Bellas, Francisco
    Antonio Becerra, Jose
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1, 2023, 589 : 283 - 294
  • [8] PIXOR: Real-time 3D Object Detection from Point Clouds
    Yang, Bin
    Luo, Wenjie
    Urtasun, Raquel
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7652 - 7660
  • [9] Real-Time Complex Object 3D Measurement
    Li, Zhongwei
    Shi, Yusheng
    Wang, Congjun
    2009 INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION, PROCEEDINGS, 2009, : 191 - 193
  • [10] DeepSDP: A Real-Time Deep Stereo Detection and Positioning Method for 3D Object Detection
    Moradi, Homayoun
    Karami, Mohammad
    Shamaghdari, Saeed
    2020 28TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2020, : 1309 - 1313