A Robust Keyframe-Based Visual SLAM for RGB-D Cameras in Challenging Scenarios

被引:2
|
作者
Lin, Xi [1 ,2 ]
Huang, Yewei [1 ]
Sun, Dingyi [2 ,3 ]
Lin, Tzu-Yuan [2 ]
Englot, Brendan [1 ]
Eustice, Ryan M. [2 ]
Ghaffari, Maani [2 ]
机构
[1] Stevens Inst Technol, Dept Mech Engn, Hoboken, NJ 07030 USA
[2] Univ Michigan, Dept Robot, Ann Arbor, MI 48109 USA
[3] Simon Fraser Univ, Sch Comp Sci, Burnaby, BC V5A 1S6, Canada
关键词
Simultaneous localization and mapping; Feature extraction; Odometry; Optimization; Manganese; Cameras; Point cloud compression; Indoor environment; Visual SLAM; RGB-D camera; indoor environments; RECONSTRUCTION;
D O I
10.1109/ACCESS.2023.3312062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The accuracy of RGB-D SLAM systems is sensitive to the image quality, and can be significantly compromised in adverse situations such as when input images are blurry, lacking in texture features, or overexposed. In this paper, based on Continuous Direct Sparse Visual Odometry (CVO), we present a novel Keyframe-based CVO (KF-CVO) with intrinsic keyframe selection mechanism that effectively reduces the tracking error. We then extend KF-CVO to a RGB-D SLAM system, CVO SLAM, equipped with place recognition via ORB features, and joint bundle adjustment & pose graph optimization. Comprehensive evaluations on publicly available benchmarks show that the proposed RGB-D SLAM system achieves a higher success rate than current state-of-the-art-methods. The proposed system is more robust to difficult benchmark sequences than current state-of-the-art methods, where adverse situations such as rapid camera motions, environments lacking in texture, and overexposed images when strong illumination exists.
引用
收藏
页码:97239 / 97249
页数:11
相关论文
共 50 条
  • [1] RGB-D dense SLAM with keyframe-based method
    Fu, Xingyin
    Zhu, Feng
    Wu, Qingxiao
    Sun, Yunlei
    THREE-DIMENSIONAL IMAGE ACQUISITION AND DISPLAY TECHNOLOGY AND APPLICATIONS, 2018, 10845
  • [2] Keyframe-based RGB-D dense visual SLAM fused semantic cues in dynamic scenes
    Zhou, Wugen
    Peng, Xiaodong
    Li, Yun
    Fan, Mingrui
    Liu, Bo
    MACHINE VISION AND APPLICATIONS, 2024, 35 (03)
  • [3] Visual SLAM with RGB-D Cameras
    Jin, Qiongyao
    Liu, Yungang
    Man, Yongchao
    Li, Fengzhong
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 4072 - 4077
  • [4] Keyframe-based RGB-D SLAM for Mobile Robots with Visual Odometry in Indoor Environments using Graph Optimization
    Soares, J. C. V.
    Meggiolaro, M. A.
    15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), 2018, : 94 - 99
  • [5] Dense Visual SLAM for RGB-D Cameras
    Kerl, Christian
    Sturm, Juergen
    Cremers, Daniel
    2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 2100 - 2106
  • [6] Visual SLAM using Multiple RGB-D Cameras
    Yang, Shaowu
    Yi, Xiaodong
    Wang, Zhiyuan
    Wang, Yanzhen
    Yang, Xuejun
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1389 - 1395
  • [7] Bayesian filtering for keyframe-based visual SLAM
    Kim, Jungho
    Yoon, Kuk-Jin
    Kweon, In So
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2015, 34 (4-5): : 517 - 531
  • [8] Robust Keyframe-based Monocular SLAM for Augmented Reality
    Liu, Haomin
    Zhang, Guofeng
    Bao, Hujun
    ADJUNCT PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), 2016, : 340 - 341
  • [9] Robust Keyframe-based Monocular SLAM for Augmented Reality
    Liu, Haomin
    Zhang, Guofeng
    Bao, Hujun
    PROCEEDINGS OF THE 2016 15TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2016, : 1 - 10
  • [10] DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Cameras
    Teed, Zachary
    Deng, Jia
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34