Real-Time 3D Object Detection on Crowded Pedestrians

被引:0
|
作者
Lu, Bin [1 ,2 ]
Li, Qing [1 ]
Liang, Yanju [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Microelect, Beijing 100029, Peoples R China
[2] Wuxi IoT Innovat Ctr Co Ltd, Wuxi 214028, Peoples R China
关键词
attention; center alignment; heatmap; point sampling;
D O I
10.3390/s23218725
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the field of autonomous driving, object detection under point clouds is indispensable for environmental perception. In order to achieve the goal of reducing blind spots in perception, many autonomous driving schemes have added low-cost blind-filling LiDAR on the side of the vehicle. Unlike point cloud target detection based on high-performance LiDAR, the blind-filling LiDARs have low vertical angular resolution and are mounted on the side of the vehicle, resulting in easily mixed point clouds of pedestrian targets in close proximity to each other. These characteristics are harmful for target detection. Currently, many research works focus on target detection under high-density LiDAR. These methods cannot effectively deal with the high sparsity of the point clouds, and the recall and detection accuracy of crowded pedestrian targets tend to be low. To overcome these problems, we propose a real-time detection model for crowded pedestrian targets, namely RTCP. To improve computational efficiency, we utilize an attention-based point sampling method to reduce the redundancy of the point clouds, then we obtain new feature tensors by the quantization of the point cloud space and neighborhood fusion in polar coordinates. In order to make it easier for the model to focus on the center position of the target, we propose an object alignment attention module (OAA) for position alignment, and we utilize an additional branch of the targets' location occupied heatmap to guide the training of the OAA module. These methods improve the model's robustness against the occlusion of crowded pedestrian targets. Finally, we evaluate the detector on KITTI, JRDB, and our own blind-filling LiDAR dataset, and our algorithm achieved the best trade-off of detection accuracy against runtime efficiency.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Real-time 3D object recognition for automatic tracker initialization
    Blaskó, G
    Fua, P
    IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDINGS, 2001, : 175 - 176
  • [32] 3D gesture based real-time object selection and recognition
    Raheja, Jagdish Lal
    Chandra, Mona
    Chaudhary, Ankit
    PATTERN RECOGNITION LETTERS, 2018, 115 : 14 - 19
  • [33] Real-Time 3D Visual Sensor for Robust Object Recognition
    Attamimi, Muhammad
    Mizutani, Akira
    Nakamura, Tomoaki
    Nagai, Takayuki
    Funakoshi, Kotaro
    Nakano, Mikio
    IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 4560 - 4565
  • [34] Real-time 3D Object Detection from Point Clouds using an RGB-D Camera
    Wang, Ya
    Xu, Shu
    Zell, Andreas
    ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, : 407 - 414
  • [35] A survey on 3D object detection in real time for autonomous driving
    Contreras, Marcelo
    Jain, Aayush
    Bhatt, Neel P.
    Banerjee, Arunava
    Hashemi, Ehsan
    FRONTIERS IN ROBOTICS AND AI, 2024, 11
  • [36] Fully automated 3D boundary detection in real-time 3D echocardiography
    Takuma, S
    Angelini, ED
    Yoshiara, K
    Liu, R
    Kazanowski, M
    Dimayuga, C
    Makita, K
    Di Tullio, MR
    Holmes, JW
    Laine, AF
    Homma, S
    JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY, 2000, 35 (02) : 469A - 470A
  • [37] N3M: Natural 3D markers for real-time object detection and pose estimation
    Hinterstoisser, Stefan
    Benhimane, Selim
    Navab, Nassir
    2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 1372 - 1378
  • [38] Real-time 3D Recognition of Manipulated Object by Robot Hand Using 3D Sensor
    Minowa, Ryo
    Namiki, Akio
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1798 - 1803
  • [39] Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds
    Simon, Martin
    Amende, Karl
    Kraus, Andrea
    Honer, Jens
    Saemann, Timo
    Kaulbersch, Hauke
    Milz, Stefan
    Gross, Horst Michael
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1190 - 1199
  • [40] TemporalNet: Real-time 2D-3D Video Object Detection
    Chen, Meihong
    Lang, Jochen
    2022 19TH CONFERENCE ON ROBOTS AND VISION (CRV 2022), 2022, : 205 - 212