Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

被引:11
|
作者
Luo, Xizhao [1 ]
Zhou, Feng [2 ]
Tao, Chongben [2 ,3 ]
Yang, Anjia [4 ,5 ]
Zhang, Peiyun [6 ]
Chen, Yonghua [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Suzhou Univ Sci & Technol, Sch Elect & Informat Engn, Suzhou 215009, Peoples R China
[3] Tsinghua Univ, Suzhou Automobile Res Inst, Suzhou 215134, Peoples R China
[4] Jinan Univ, Sch Informat Sci & Technol, Guangzhou 510632, Peoples R China
[5] Jinan Univ, Sch Cyber Secur, Guangzhou 510632, Peoples R China
[6] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Feature extraction; Three-dimensional displays; Point cloud compression; Object detection; Cameras; Heuristic algorithms; Autonomous vehicles; 3D target detection; autonomous driving; PointRCNN; multi-feature fusion; OBJECT DETECTION; VEHICLE; NETWORK; VISION;
D O I
10.1109/TITS.2022.3176390
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Current 3D target detection methods used in the field of autonomous driving generally have low real-time performance and insufficient target context feature to detect dynamic multi-target accurately. In order to solve these problems, a dynamic multi-target detection algorithm of voxel point cloud fusion based on PointRCNN is proposed, which adopts a two-stage detection structure. The first stage directly processes the point cloud to extract key point features and divides voxel space. A novel submanifold sparse convolution is used to extract voxel features. Then key point features and voxel features of the point cloud are merged to generate pre-selection boxes. In the second stage, reference points are set based on the voxel features. The features of key points around reference points are merged for the second time to achieve optimized detection boxes. Finally, for the problem of inconsistent confidence, a mandatory consistency loss function is proposed to improve the accuracy of the detection box. The proposed algorithm was compared with other algorithms in three different datasets, and further tested on a self-made dataset from an actual vehicle platform. Results showed that the proposed algorithm had higher accuracy, better robustness, stronger generalization ability for dynamic multi-target detection.
引用
收藏
页码:20707 / 20720
页数:14
相关论文
共 50 条
  • [41] WeldNet: A voxel-based deep learning network for point cloud annular weld seam detection
    WANG Hui
    RONG YouMin
    XU JiaJun
    XIANG SongMing
    PENG YiFan
    HUANG Yu
    Science China(Technological Sciences), 2024, 67 (04) : 1215 - 1225
  • [42] WeldNet: A voxel-based deep learning network for point cloud annular weld seam detection
    Wang, Hui
    Rong, Youmin
    Xu, Jiajun
    Xiang, Songming
    Peng, Yifan
    Huang, Yu
    SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2024, 67 (04) : 1215 - 1225
  • [43] An Efficient Accelerator for Point-based and Voxel-based Point Cloud Neural Networks
    Yang, Xinhao
    Fu, Tianyu
    Dai, Guohao
    Zeng, Shulin
    Zhong, Kai
    Hong, Ke
    Wang, Yu
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [44] GCI fusion based multi-detection multitarget tracking
    Gao, Lin
    Battistelli, Giorgio
    Chisci, Luigi
    Farina, Alfonso
    2020 IEEE RADAR CONFERENCE (RADARCONF20), 2020,
  • [45] GraVoS: Voxel Selection for 3D Point-Cloud Detection
    Shrout, Oren
    Ben-Shabat, Yizhak
    Tal, Ayellet
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21684 - 21693
  • [46] A Point Cloud Distortion Removing and Mapping Algorithm based on Lidar and IMU UKF Fusion
    Zhang, Biao
    Zhang, Xiaoyuan
    Wei, Baochen
    Qi, Chenkun
    2019 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2019, : 966 - 971
  • [47] Multi-Robot Point Cloud Map Fusion Algorithm Based on Visual SLAM
    Chen, Yanjiang
    Wang, Yanbo
    Lin, Junqin
    Chen, Zhihong
    Wang, Yao
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 329 - 333
  • [48] Mobile Robot Localization and Mapping Algorithm Based on the Fusion of Image and Laser Point Cloud
    Dai, Jun
    Li, Dongfang
    Li, Yanqin
    Zhao, Junwei
    Li, Wenbo
    Liu, Gang
    SENSORS, 2022, 22 (11)
  • [49] Voxel-based quadrilateral mesh generation from point cloud
    Guan, Boliang
    Lin, Shujin
    Wang, Ruomei
    Zhou, Fan
    Luo, Xiaonan
    Zheng, Yongchuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (29-30) : 20561 - 20578
  • [50] A Framework of Point Cloud Simplification Based on Voxel Grid and Its Applications
    Shi, Le
    Luo, Jun
    IEEE SENSORS JOURNAL, 2024, 24 (05) : 6349 - 6357