FuseNet: 3D Object Detection Network with Fused Information for Lidar Point Clouds

被引:2
|
作者
Liu, Biao [1 ]
Tian, Bihao [1 ]
Wang, Hengyang [1 ]
Qiao, Junchao [1 ]
Wang, Zhi [2 ]
机构
[1] Beijing Jiaotong Univ, Sch Elect Engn, Beijing 100044, Peoples R China
[2] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
基金
北京市自然科学基金;
关键词
Computer vision; Point cloud; Neural networks; Object detection; Voxelization;
D O I
10.1007/s11063-022-10848-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D object detection from lidar point cloud has an important role in the environment sensing system of autonomous driving vehicles. In this paper, we propose two modules for object detection works by more detailed voxel initial information extraction and full fusion of context information. Additionally, we extract density information as the initial feature of the voxels and fully confuse the coordinate and density information with a point-based method to reduce the loss of original data caused by voxelization. Second, we extract the voxel features with a backbone neural network based on 3D sparse convolution. We propose a Cross-connected Region Proposal Network to integrate multiscale and multidepth regional features and to obtain high-quality 3D proposal regions. In addition, we extend the target generation strategy in the anchor-based 3D object detection algorithm, which stabilizes the network performance for multiple objections. Our modules can be flexibly applied to state-of-the-art models and effectively improves the network performance, which proves the effectiveness of the modules that we proposed.
引用
收藏
页码:5063 / 5078
页数:16
相关论文
共 50 条
  • [31] A robust scheme for copy detection of 3D object point clouds
    Yang, Jiaqi
    Lu, Xuequan
    Chen, Wenzhi
    NEUROCOMPUTING, 2022, 510 : 181 - 192
  • [32] Weakly Supervised 3D Object Detection from Point Clouds
    Qin, Zengyi
    Wang, Jinglu
    Lu, Yan
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4144 - 4152
  • [33] 3D Object Detection on Synthetic Point Clouds for Railway Applications
    Neri, Michael
    Battisti, Federica
    2022 10TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2022,
  • [34] PDANet: Point Distribution Awareness for 3-D Object Detection From LiDAR Point Clouds
    Tang, Miao
    Yu, Dianyu
    Hu, Qingyong
    Dai, Wenxia
    Xiao, Wen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [35] DALi: Domain Adaptation in LiDAR Point Clouds for 3D Obstacle Detection
    Cortes, Irene
    Beltran, Jorge
    de la Escalera, Arturo
    Garcia, Fernando
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3837 - 3842
  • [36] Spatial information enhancement network for 3D object detection from point cloud
    Li, Ziyu
    Yao, Yuncong
    Quan, Zhibin
    Xie, Jin
    Yang, Wankou
    PATTERN RECOGNITION, 2022, 128
  • [37] BirdNet: a 3D Object Detection Framework from LiDAR Information
    Beltran, Jorge
    Guindel, Carlos
    Miguel Moreno, Francisco
    Cruzado, Daniel
    Garcia, Fernando
    de la Escalera, Arturo
    2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2018, : 3517 - 3523
  • [38] LiDAR based 3D object detection using CCD information
    Kim, Jung-Un
    Kang, Hang-Bong
    2017 IEEE THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2017), 2017, : 303 - 309
  • [39] Point Clouds: Lidar versus 3D Vision
    Leberl, F.
    Irschara, A.
    Pock, T.
    Meixner, P.
    Gruber, M.
    Scholz, S.
    Wiechert, A.
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2010, 76 (10): : 1123 - 1134
  • [40] Reinforcing LiDAR-Based 3D Object Detection with RGB and 3D Information
    Liu, Wenjian
    Zhou, Yue
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 199 - 209