Deep ViDAR: CNN Based 360° Panoramic Video System for Outdoor Robot Visual Navigation and SLAM

被引:1
|
作者
Liang, Chang [1 ]
Tie, Yun [1 ]
Qi, Lin [1 ]
Bi, Cheng [1 ]
机构
[1] Zhengzhou Univ, Sch Informat Engn, Zhengzhou, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
panoramic camera; semantic segmentation; visual navigation;
D O I
10.1117/12.2503134
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Normally we use a laser radar to measure the area which the robot can move, while there is relatively fixed semantic information in outdoor environments, especially roads. With deep learning in a wide range of applications of semantic image segmentation, we believe that the image information panoramic video stream semantic segmentation, enabling the robot to navigate rely on cameras in most scenes. Our proposed system can be performed for segmenting the image information in each camera, combined with the panoramic image stitching, which can reduce the cost of the hardware of robot navigation.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] 360ORB-SLAM: A Visual SLAM System for Panoramic Images with Depth Completion Network
    Chen, Yichen
    Pan, Yuqi
    Liu, Ruyu
    Zhang, Haoyu
    Zhang, Guodao
    Sung, Bo
    Zhang, Jianhua
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 717 - 722
  • [2] Outdoor Robot Navigation Using Gmapping Based SLAM Algorithm
    Balasuriya, B. L. E. A.
    Chathuranga, B. A. H.
    Jayasundara, B. H. M. D.
    Napagoda, N. R. A. C.
    Kumarawadu, S. P.
    Chandima, D. P.
    Jayasekara, A. G. B. P.
    2ND INTERNATIONAL MERCON 2016 MORATUWA ENGINEERING RESEARCH CONFERENCE, 2016, : 403 - 408
  • [3] Visual Navigation Method for Robot Based on Improved ORB-SLAM2
    Dong R.
    Wang Y.
    Kan J.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (10): : 306 - 317
  • [4] A visual model of welding robot based on CNN deep learning
    Li H.
    Han X.
    Fang Z.
    Hanjie Xuebao/Transactions of the China Welding Institution, 2019, 40 (02): : 154 - 160
  • [5] A Visual Perception Based View Navigation Trick Mode in the Panoramic Video Streaming Service
    Seok, Joo Myoung
    Ko, Junggon
    Lee, Younghun
    Suh, Doug Young
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2011, E94B (12) : 3631 - 3634
  • [6] See-Shop System: An Assistive Outdoor Navigation System for the Visual Impaired Based on Deep Learning Methods
    Wang, Junjie
    Zhao, Shanshan
    2023 INTERNATIONAL CONFERENCE ON ADVANCED ENTERPRISE INFORMATION SYSTEM, AEIS 2023, 2023, : 16 - 20
  • [7] MuCaSLAM: CNN-Based Frame Quality Assessment for Mobile Robot with Omnidirectional Visual SLAM
    Karpyshev, Pavel
    Kruzhkov, Evgeny
    Yudin, Evgeny
    Savinykh, Alena
    Potapov, Andrei
    Kurenkov, Mikhail
    Kolomeytsev, Anton
    Kalinov, Ivan
    Tsetserukou, Dzmitry
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 368 - 373
  • [8] A CNN-Based System for Mobile Robot Navigation in Indoor Environments via Visual Localization with a Small Dataset
    Foroughi, Farzin
    Chen, Zonghai
    Wang, Jikai
    WORLD ELECTRIC VEHICLE JOURNAL, 2021, 12 (03):
  • [9] Multi-robot, EKF-based visual SLAM system
    Schmidt, Adam
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8671 : 562 - 569
  • [10] Multi-robot, EKF-Based Visual SLAM System
    Schmidt, Adam
    COMPUTER VISION AND GRAPHICS, ICCVG 2014, 2014, 8671 : 562 - 569