Effective Free-Driving Region Detection for Mobile Robots by Uncertainty Estimation Using RGB-D Data

被引:2
|
作者
Nguyen, Toan-Khoa [1 ]
Nguyen, Phuc Thanh-Thien [1 ]
Nguyen, Dai-Dong [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Engn, Taipei 106335, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106319, Taiwan
关键词
mobile robots; self-supervised learning; semantic segmentation; automatic labeling; DRIVABLE AREA;
D O I
10.3390/s22134751
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Accurate segmentation of drivable areas and road obstacles is critical for autonomous mobile robots to navigate safely in indoor and outdoor environments. With the fast advancement of deep learning, mobile robots may now perform autonomous navigation based on what they learned in the learning phase. On the other hand, existing techniques often have low performance when confronted with complex situations since unfamiliar objects are not included in the training dataset. Additionally, the use of a large amount of labeled data is generally essential for training deep neural networks to achieve good performance, which is time-consuming and labor-intensive. Thus, this paper presents a solution to these issues by proposing a self-supervised learning method for the drivable areas and road anomaly segmentation. First, we propose the Automatic Generating Segmentation Label (AGSL) framework, which is an efficient system automatically generating segmentation labels for drivable areas and road anomalies by finding dissimilarities between the input and resynthesized image and localizing obstacles in the disparity map. Then, we train RGB-D datasets with a semantic segmentation network using self-generated ground truth labels derived from our method (AGSL labels) to get the pre-trained model. The results showed that our AGSL achieved high performance in labeling evaluation, and the pre-trained model also obtains certain confidence in real-time segmentation application on mobile robots.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] People detection and tracking using RGB-D cameras for mobile robots
    Liu, Hengli
    Luo, Jun
    Wu, Peng
    Xie, Shaorong
    Li, Hengyu
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2016, 13 : 1 - 11
  • [2] Salient Regions Detection for Indoor Robots using RGB-D Data
    Jiang, Lixing
    Koch, Artur
    Zell, Andreas
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 1323 - 1328
  • [3] Real Time Person Detection and Tracking by Mobile Robots using RGB-D Images
    Vo, Duc My
    Jiang, Lixing
    Zell, Andreas
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS IEEE-ROBIO 2014, 2014, : 689 - 694
  • [4] Construction of Roadmaps for Mobile Robots' Navigation Using RGB-D Cameras
    Savage, Jesus
    Contreras, Luis
    Figueroa, Israel
    Pacheco, Abel
    Bermudez, Alejandro
    Negrete, Marco
    Matamoros, Mauricio
    Rivera, Carlos
    INTELLIGENT AUTONOMOUS SYSTEMS 13, 2016, 302 : 217 - 229
  • [5] Indoor Home Furniture Detection with RGB-D Data for Service Robots
    Alonso-Ramirez, Oscar
    Marin-Hernandez, Antonio
    Devy, Michel
    Montes-Gonzalez, Fernando M.
    2014 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND COMPUTERS (CONIELECOMP), 2014, : 172 - 177
  • [6] Pedestrian Proximity Detection using RGB-D Data
    Tupper, Adam
    Green, Richard
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2019,
  • [7] Vehicles overtaking detection using RGB-D data
    Xia, Yingjie
    Wang, Chunhui
    Shi, Xingmin
    Zhang, Luming
    SIGNAL PROCESSING, 2015, 112 : 98 - 109
  • [8] Real-time SLAM Using an RGB-D Camera For Mobile Robots
    Hao, Chung Kuo
    Mayer, N. Michael
    2013 CACS INTERNATIONAL AUTOMATIC CONTROL CONFERENCE (CACS), 2013, : 356 - +
  • [9] Building 3D semantic maps for mobile robots using RGB-D camera
    Zhe Zhao
    Xiaoping Chen
    Intelligent Service Robotics, 2016, 9 : 297 - 309
  • [10] Building 3D semantic maps for mobile robots using RGB-D camera
    Zhao, Zhe
    Chen, Xiaoping
    INTELLIGENT SERVICE ROBOTICS, 2016, 9 (04) : 297 - 309