SpinNet: Spinning convolutional network for lane boundary detection

被引:21
|
作者
Fan, Ruochen [1 ]
Wang, Xuanrun [2 ]
Hou, Qibin [3 ]
Liu, Hanchao [2 ]
Mu, Tai-Jiang [2 ]
机构
[1] Tsinghua Univ, Dept Comp Sci, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[3] Nankai Univ, Media Grp, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; lane boundary detection; autonomous driving; deep learning;
D O I
10.1007/s41095-019-0160-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a simple but effective framework for lane boundary detection, called SpinNet. Considering that cars or pedestrians often occlude lane boundaries and that the local features of lane boundaries are not distinctive, therefore, analyzing and collecting global context information is crucial for lane boundary detection. To this end, we design a novel spinning convolution layer and a brand-new lane parameterization branch in our network to detect lane boundaries from a global perspective. To extract features in narrow strip-shaped fields, we adopt strip-shaped convolutions with kernels which have 1 x n or n x 1 shape in the spinning convolution layer. To tackle the problem of that straight strip-shaped convolutions are only able to extract features in vertical or horizontal directions, we introduce the concept of feature map rotation to allow the convolutions to be applied in multiple directions so that more information can be collected concerning a whole lane boundary. Moreover, unlike most existing lane boundary detectors, which extract lane boundaries from segmentation masks, our lane boundary parameterization branch predicts a curve expression for the lane boundary for each pixel in the output feature map. And the network utilizes this information to predict the weights of the curve, to better form the final lane boundaries. Our framework is easy to implement and end-to-end trainable. Experiments show that our proposed SpinNet outperforms state-of-the-art methods.
引用
收藏
页码:417 / 428
页数:12
相关论文
共 50 条
  • [1] SpinNet: Spinning convolutional network for lane boundary detection
    Ruochen Fan
    Xuanrun Wang
    Qibin Hou
    Hanchao Liu
    Tai-Jiang Mu
    Computational Visual Media, 2019, 5 : 417 - 428
  • [2] SpinNet: Spinning convolutional network for lane boundary detection
    Ruochen Fan
    Xuanrun Wang
    Qibin Hou
    Hanchao Liu
    Tai-Jiang Mu
    Computational Visual Media, 2019, 5 (04) : 417 - 428
  • [3] Lane Detection Based on a Lightweight Convolutional Neural Network
    Hu Jie
    Xiong Zongquan
    Xu Wencai
    Cao Kai
    Lu Ruoyu
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (10)
  • [4] Lane marking detection via deep convolutional neural network
    Tian, Yan
    Gelernter, Judith
    Wang, Xun
    Chen, Weigang
    Gao, Junxiang
    Zhang, Yujie
    Li, Xiaolan
    NEUROCOMPUTING, 2018, 280 : 46 - 55
  • [5] Traffic Lane Detection using Fully Convolutional Neural Network
    Zang, Jinju
    Zhou, Wei
    Zhang, Guanwen
    Duan, Zhemin
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 305 - 311
  • [6] Lane detection using lane boundary marker network with road geometry constraints
    Khan, Hussam Ullah
    Ali, Afsheen Rafaqat
    Hassan, Ali
    Ali, Ahmed
    Kazmi, Wajahat
    Zaheer, Aamer
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 1823 - 1832
  • [7] Lane line detection incorporating CBAM mechanism and deformable convolutional network
    Hu, Dandan
    Zhang, Zhongting
    Niu, Guochen
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (07): : 2150 - 2160
  • [8] Multi-Lane Detection Based on Deep Convolutional Neural Network
    Fan Chao
    Song Yu-Pei
    Mao Ya-Jie
    IEEE ACCESS, 2019, 7 : 150833 - 150841
  • [9] MLP-Based Efficient Convolutional Neural Network for Lane Detection
    Yao, Xuedong
    Wang, Yandong
    Wu, Yanlan
    He, Guoxiong
    Luo, Shuchang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (10) : 12602 - 12614
  • [10] Boundary graph convolutional network for temporal action detection
    Chen, Yaosen
    Guo, Bing
    Shen, Yan
    Wang, Wei
    Lu, Weichen
    Suo, Xinhua
    IMAGE AND VISION COMPUTING, 2021, 109