Effective Free-Driving Region Detection for Mobile Robots by Uncertainty Estimation Using RGB-D Data

被引:2
|
作者
Nguyen, Toan-Khoa [1 ]
Nguyen, Phuc Thanh-Thien [1 ]
Nguyen, Dai-Dong [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Engn, Taipei 106335, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106319, Taiwan
关键词
mobile robots; self-supervised learning; semantic segmentation; automatic labeling; DRIVABLE AREA;
D O I
10.3390/s22134751
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Accurate segmentation of drivable areas and road obstacles is critical for autonomous mobile robots to navigate safely in indoor and outdoor environments. With the fast advancement of deep learning, mobile robots may now perform autonomous navigation based on what they learned in the learning phase. On the other hand, existing techniques often have low performance when confronted with complex situations since unfamiliar objects are not included in the training dataset. Additionally, the use of a large amount of labeled data is generally essential for training deep neural networks to achieve good performance, which is time-consuming and labor-intensive. Thus, this paper presents a solution to these issues by proposing a self-supervised learning method for the drivable areas and road anomaly segmentation. First, we propose the Automatic Generating Segmentation Label (AGSL) framework, which is an efficient system automatically generating segmentation labels for drivable areas and road anomalies by finding dissimilarities between the input and resynthesized image and localizing obstacles in the disparity map. Then, we train RGB-D datasets with a semantic segmentation network using self-generated ground truth labels derived from our method (AGSL labels) to get the pre-trained model. The results showed that our AGSL achieved high performance in labeling evaluation, and the pre-trained model also obtains certain confidence in real-time segmentation application on mobile robots.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Dexterous Manipulation Based on Object Recognition and Accurate Pose Estimation Using RGB-D Data
    Manawadu, Udaka A.
    Keitaro, Naruse
    Sensors, 24 (21):
  • [32] Keyframe-based RGB-D SLAM for Mobile Robots with Visual Odometry in Indoor Environments using Graph Optimization
    Soares, J. C. V.
    Meggiolaro, M. A.
    15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), 2018, : 94 - 99
  • [33] Albedo estimation for real-time 3D reconstruction using RGB-D and IR data
    Stotko, Patrick
    Weinmann, Michael
    Klein, Reinhard
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 150 : 213 - 225
  • [34] Context-aware 6D pose estimation of known objects using RGB-D data
    Ankit Kumar
    Priya Shukla
    Vandana Kushwaha
    Gora Chand Nandi
    Multimedia Tools and Applications, 2024, 83 : 52973 - 52987
  • [35] Context-aware 6D pose estimation of known objects using RGB-D data
    Kumar, Ankit
    Shukla, Priya
    Kushwaha, Vandana
    Nandi, Gora Chand
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (17) : 52973 - 52987
  • [36] SHREC 2022: Pothole and crack detection in the road pavement using images and RGB-D data
    Thompson, Elia Moscoso
    Ranieri, Andrea
    Biasotti, Silvia
    Chicchon, Miguel
    Sipiran, Ivan
    Pham, Minh-Khoi
    Nguyen-Ho, Thang-Long
    Nguyen, Hai-Dang
    Tran, Minh-Triet
    COMPUTERS & GRAPHICS-UK, 2022, 107 : 161 - 171
  • [37] Tracking an RGB-D Camera on Mobile Devices Using an Improved Frame-to-Frame Pose Estimation Method
    An, Jaepung
    Lee, Jaehyun
    Jeong, Jiman
    Ihm, Insung
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 1142 - 1150
  • [38] Visual Attention and Color Cues for 6D Pose Estimation on Occluded Scenarios Using RGB-D Data
    Vidal, Joel
    Lin, Chyi-Yeu
    Marti, Robert
    SENSORS, 2021, 21 (23)
  • [39] Real-Time Human Detection and Tracking from a Mobile Armed Robot using RGB-D Sensor
    Kahily, Hashim Masod
    Sudheer, A. P.
    2016 WORLD CONFERENCE ON FUTURISTIC TRENDS IN RESEARCH AND INNOVATION FOR SOCIAL WELFARE (STARTUP CONCLAVE), 2016,
  • [40] Automated risk assessment for scene understanding and domestic robots using RGB-D data and 2.5D CNNs at a patch level
    Dupre, Rob
    Tzimiropoulos, Georgios
    Argyriou, Vasileios
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 476 - 477