Real-Time 3D Object Detection on Crowded Pedestrians

被引:0
|
作者
Lu, Bin [1 ,2 ]
Li, Qing [1 ]
Liang, Yanju [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Microelect, Beijing 100029, Peoples R China
[2] Wuxi IoT Innovat Ctr Co Ltd, Wuxi 214028, Peoples R China
关键词
attention; center alignment; heatmap; point sampling;
D O I
10.3390/s23218725
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of autonomous driving, object detection under point clouds is indispensable for environmental perception. In order to achieve the goal of reducing blind spots in perception, many autonomous driving schemes have added low-cost blind-filling LiDAR on the side of the vehicle. Unlike point cloud target detection based on high-performance LiDAR, the blind-filling LiDARs have low vertical angular resolution and are mounted on the side of the vehicle, resulting in easily mixed point clouds of pedestrian targets in close proximity to each other. These characteristics are harmful for target detection. Currently, many research works focus on target detection under high-density LiDAR. These methods cannot effectively deal with the high sparsity of the point clouds, and the recall and detection accuracy of crowded pedestrian targets tend to be low. To overcome these problems, we propose a real-time detection model for crowded pedestrian targets, namely RTCP. To improve computational efficiency, we utilize an attention-based point sampling method to reduce the redundancy of the point clouds, then we obtain new feature tensors by the quantization of the point cloud space and neighborhood fusion in polar coordinates. In order to make it easier for the model to focus on the center position of the target, we propose an object alignment attention module (OAA) for position alignment, and we utilize an additional branch of the targets' location occupied heatmap to guide the training of the OAA module. These methods improve the model's robustness against the occlusion of crowded pedestrian targets. Finally, we evaluate the detector on KITTI, JRDB, and our own blind-filling LiDAR dataset, and our algorithm achieved the best trade-off of detection accuracy against runtime efficiency.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Real-time Spatial-temporal Context Approach for 3D Object Detection using LiDAR
    Kumar, K. S. Chidanand
    Al-Stouhi, Samir
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON VEHICLE TECHNOLOGY AND INTELLIGENT TRANSPORT SYSTEMS (VEHITS), 2020, : 432 - 439
  • [42] Real-Time 3D Object Detection, Recognition and Presentation Using a Mobile Device for Assistive Navigation
    Chen J.
    Zhu Z.
    SN Computer Science, 4 (5)
  • [43] PillarNet: Real-Time and High-Performance Pillar-Based 3D Object Detection
    Shi, Guangsheng
    Li, Ruifeng
    Ma, Chao
    COMPUTER VISION, ECCV 2022, PT X, 2022, 13670 : 35 - 52
  • [44] MonoAMNet: Three-Stage Real-Time Monocular 3D Object Detection With Adaptive Methods
    Pan, Huihui
    Jia, Yisong
    Wang, Jue
    Sun, Weichao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (03) : 3574 - 3587
  • [45] Lightweight convolutional neural network for real-time 3D object detection in road and railway environments
    Mauri, A.
    Khemmar, R.
    Decoux, B.
    Haddad, M.
    Boutteau, R.
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2022, 19 (03) : 499 - 516
  • [46] Lightweight convolutional neural network for real-time 3D object detection in road and railway environments
    A. Mauri
    R. Khemmar
    B. Decoux
    M. Haddad
    R. Boutteau
    Journal of Real-Time Image Processing, 2022, 19 : 499 - 516
  • [47] Real-time Hierarchical Soft Attention-based 3D Object Detection in Point Clouds
    Chen, Qiuxiao
    Qi, Xiaojun
    Song, Ziqi
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2928 - 2934
  • [48] Cascading classifier with discriminative multi-features for a specific 3D object real-time detection
    Wang, Rui
    Liang, Ying
    Xu, Jing Wen
    He, Zhi Hai
    VISUAL COMPUTER, 2019, 35 (03): : 399 - 414
  • [49] Cascading classifier with discriminative multi-features for a specific 3D object real-time detection
    Rui Wang
    Ying Liang
    Jing Wen Xu
    Zhi Hai He
    The Visual Computer, 2019, 35 : 399 - 414
  • [50] A Photogrammetric Approach for Real-time 3D Localization and Tracking of Pedestrians in Monocular Infrared Imagery
    Kundegorski, Mikolaj E.
    Breckon, Toby P.
    OPTICS AND PHOTONICS FOR COUNTERTERRORISM, CRIME FIGHTING, AND DEFENCE X; AND OPTICAL MATERIALS AND BIOMATERIALS IN SECURITY AND DEFENCE SYSTEMS TECHNOLOGY XI, 2014, 9253