FuseNet: 3D Object Detection Network with Fused Information for Lidar Point Clouds

被引:2
|
作者
Liu, Biao [1 ]
Tian, Bihao [1 ]
Wang, Hengyang [1 ]
Qiao, Junchao [1 ]
Wang, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
基金
北京市自然科学基金;
关键词
Computer vision; Point cloud; Neural networks; Object detection; Voxelization;
D O I
10.1007/s11063-022-10848-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection from lidar point cloud has an important role in the environment sensing system of autonomous driving vehicles. In this paper, we propose two modules for object detection works by more detailed voxel initial information extraction and full fusion of context information. Additionally, we extract density information as the initial feature of the voxels and fully confuse the coordinate and density information with a point-based method to reduce the loss of original data caused by voxelization. Second, we extract the voxel features with a backbone neural network based on 3D sparse convolution. We propose a Cross-connected Region Proposal Network to integrate multiscale and multidepth regional features and to obtain high-quality 3D proposal regions. In addition, we extend the target generation strategy in the anchor-based 3D object detection algorithm, which stabilizes the network performance for multiple objections. Our modules can be flexibly applied to state-of-the-art models and effectively improves the network performance, which proves the effectiveness of the modules that we proposed.
引用
收藏
页码:5063 / 5078
页数:16
相关论文
共 50 条
  • [21] End-to-End Multi-View Fusion for 3D Object Detection in LiDAR Point Clouds
    Zhou, Yin
    Sun, Pei
    Zhang, Yu
    Anguelov, Dragomir
    Gao, Jiyang
    Ouyang, Tom
    Guo, James
    Ngiam, Jiquan
    Vasudevan, Vijay
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [22] Instant Object Detection in Lidar Point Clouds
    Borcs, Attila
    Nagy, Balazs
    Benedek, Csaba
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (07) : 992 - 996
  • [23] Knowledge guided object detection and identification in 3D Point Clouds
    Karmacharya, A.
    Boochs, F.
    Tietz, B.
    VIDEOMETRICS, RANGE IMAGING, AND APPLICATIONS XIII, 2015, 9528
  • [24] 3D Object Detection with Normal-map on Point Clouds
    Miao, Jishu
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 569 - 576
  • [25] Deep Hough Voting for 3D Object Detection in Point Clouds
    Qi, Charles R.
    Litany, Or
    He, Kaiming
    Guibas, Leonidas J.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9276 - 9285
  • [26] Lidar Point Cloud Guided Monocular 3D Object Detection
    Peng, Liang
    Liu, Fei
    Yu, Zhengxu
    Yan, Senbo
    Deng, Dan
    Yang, Zheng
    Liu, Haifeng
    Cai, Deng
    COMPUTER VISION - ECCV 2022, PT I, 2022, 13661 : 123 - 139
  • [27] Weakly Supervised Point Clouds Transformer for 3D Object Detection
    Tang, Zuojin
    Sun, Bo
    Ma, Tongwei
    Li, Daosheng
    Xu, Zhenhui
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3948 - 3955
  • [28] 3D Object Detection Algorithm Based on Raw Point Clouds
    Zhang, Dongdong
    Guo, Jie
    Chen, Yang
    Computer Engineering and Applications, 2024, 59 (03) : 209 - 217
  • [29] Boosting 3D Object Detection by Simulating Multimodality on Point Clouds
    Zheng, Wu
    Hong, Mingxuan
    Jiang, Li
    Fu, Chi-Wing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 13628 - 13637
  • [30] Boundary points guided 3D object detection for point clouds
    Tang, Qingsong
    Yang, Mingzhi
    Wang, Ziyi
    Dong, Wenhao
    Liu, Yang
    APPLIED SOFT COMPUTING, 2024, 165