Fast Road Detection by CNN-Based Camera-Lidar Fusion and Spherical Coordinate Transformation

被引:21
|
作者
Lee, Jae-Seol [1 ]
Park, Tae-Hyoung [2 ]
机构
[1] Chungbuk Natl Univ, Dept Control & Robot Engn, Cheongju 28644, South Korea
[2] Chungbuk Natl Univ, Sch Elect Engn, Cheongju 28644, South Korea
关键词
Laser radar; Cameras; Sensor fusion; Autonomous vehicles; Image segmentation; Convolutional neural networks; Road detection; lidar and camera fusion; segmentation; convolution neural network; spherical coordinate transformation; autonomous vehicles; SEGMENTATION;
D O I
10.1109/TITS.2020.2988302
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
We propose a new camera-lidar fusion method for road detection where the spherical coordinate transformation is introduced to decrease the gap between the point cloud of 3D lidar data. The camera's color data and the 3D lidar's height data are transformed into the same spherical coordinate, and then input to the convolution neural network for segmentation. Faster segmentation is possible due to the reduced size of input data. To increase the detection accuracy, this modified SegNet expands the receptive field of the network. Using the KITTI dataset, we present the experimental results to show the usefulness of the proposed method.
引用
收藏
页码:5802 / 5810
页数:9
相关论文
共 50 条
  • [41] Road detection based on the fusion of Lidar and image data
    Han, Xiaofeng
    Wang, Huan
    Lu, Jianfeng
    Zhao, Chunxia
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2017, 14 (06):
  • [42] Road Sign Detection and Localization Based on Camera and Lidar Data
    Buyval, Alexander
    Gabdullin, Aidar
    Lyubimov, Maxim
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041
  • [43] CNN-based multi-frame IMO detection from a monocular camera
    Fanani, Nolang
    Ochs, Matthias
    Stuerck, Alina
    Mester, Rudolf
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 957 - 964
  • [44] Faster CNN-based vehicle detection and counting strategy for fixed camera scenes
    Gomaa, Ahmed
    Minematsu, Tsubasa
    Abdelwahab, Moataz M.
    Abo-Zahhad, Mohammed
    Taniguchi, Rin-ichiro
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (18) : 25443 - 25471
  • [45] Faster CNN-based vehicle detection and counting strategy for fixed camera scenes
    Ahmed Gomaa
    Tsubasa Minematsu
    Moataz M. Abdelwahab
    Mohammed Abo-Zahhad
    Rin-ichiro Taniguchi
    Multimedia Tools and Applications, 2022, 81 : 25443 - 25471
  • [46] Fusion of LiDAR and Camera by Scanning in LiDAR Imagery and Image-Guided Diffusion for Urban Road Detection
    Zhang, Yigong
    Gu, Shuo
    Yang, Jian
    Alvarez, Jose M.
    Kong, Hui
    2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 579 - 584
  • [47] A CNN-Based Length-Aware Cascade Road Damage Detection Approach
    Xu, Huiqing
    Chen, Bin
    Qin, Jian
    SENSORS, 2021, 21 (03) : 1 - 19
  • [48] Panoptic-FusionNet: Camera-LiDAR fusion-based point cloud panoptic segmentation for autonomous driving
    Song, Hamin
    Cho, Jieun
    Ha, Jinsu
    Park, Jaehyun
    Jo, Kichun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 251
  • [49] CNN-Based Hyperparameter Optimization Approach for Road Pothole and Crack Detection Systems
    Hernanda, Zahra Salsabila
    Mahmudah, Hani'ah
    Sudibyo, Rahardhita Widyatra
    2022 IEEE WORLD AI IOT CONGRESS (AIIOT), 2022, : 538 - 543
  • [50] CNN-based Human Detection Using a 3D LiDAR onboard a UAV
    Hayton, Jack N. C.
    Barros, Tiago
    Premebida, Cristiano
    Coombes, Matthew J.
    Nunes, Urbano J.
    2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020), 2020, : 312 - 318