A robust RGB-D visual odometry with moving object detection in dynamic indoor scenes

被引:2
|
作者
Zhang, Xianglong [1 ]
Yu, Haiyang [1 ]
Zhuang, Yan [2 ]
机构
[1] Dalian Minzu Univ, Coll Mech & Elect Engn, Dalian, Peoples R China
[2] Dalian Univ Technol, Sch Control Sci & Engn, Dalian, Peoples R China
基金
中国国家自然科学基金;
关键词
dynamic indoor scenes; moving object detection; RGB-D SLAM; visual odometry; D SLAM; MOTION REMOVAL;
D O I
10.1049/csy2.12079
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localisation and mapping (SLAM) are the basis for many robotic applications. As the front end of SLAM, visual odometry is mainly used to estimate camera pose. In dynamic scenes, classical methods are deteriorated by dynamic objects and cannot achieve satisfactory results. In order to improve the robustness of visual odometry in dynamic scenes, this paper proposed a dynamic region detection method based on RGB-D images. Firstly, all feature points on the RGB image are classified as dynamic and static using a triangle constraint and the epipolar geometric constraint successively. Meanwhile, the depth image is clustered using the K-Means method. The classified feature points are mapped to the clustered depth image, and a dynamic or static label is assigned to each cluster according to the number of dynamic feature points. Subsequently, a dynamic region mask for the RGB image is generated based on the dynamic clusters in the depth image, and the feature points covered by the mask are all removed. The remaining static feature points are applied to estimate the camera pose. Finally, some experimental results are provided to demonstrate the feasibility and performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] DYNAMIC SELECTION NETWORK FOR RGB-D SALIENT OBJECT DETECTION
    Zhou, Jinlin
    Luo, Zhiming
    Li, Shaozi
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 776 - 780
  • [42] Nonparametric Statistical and Clustering Based RGB-D Dense Visual Odometry in a Dynamic Environment
    Zhou, Wugen
    Peng, Xiaodong
    Wang, Haijiao
    Liu, Bo
    3D RESEARCH, 2019, 10 (02):
  • [43] Visual Odometry Algorithm Using an RGB-D Sensor and IMU in a Highly Dynamic Environment
    Kim, Deok-Hwa
    Han, Seung-Beom
    Kim, Jong-Hwan
    ROBOT INTELLIGENCE TECHNOLOGY ANDAPPLICATIONS 3, 2015, 345 : 11 - 26
  • [44] RGB-D Dense Visual Odometry through Pixel Level Segmentation in Dynamic Environments
    Oh, Changsuk
    Jang, Youngseok
    Kim, H. Jin
    2019 19TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2019), 2019, : 1296 - 1300
  • [45] RGB-D IBR: Rendering Indoor Scenes Using Sparse RGB-D Images with Local Alignments
    Jeong, Yeongyu
    Kim, Haejoon
    Seo, Hyewon
    Cordier, Frederic
    Lee, Seungyong
    PROCEEDINGS I3D 2016: 20TH ACM SIGGRAPH SYMPOSIUM ON INTERACTIVE 3D GRAPHICS AND GAMES, 2016, : 205 - 206
  • [46] Robust RGB-D Odometry Using Point and Line Features
    Lu, Yan
    Song, Dezhen
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3934 - 3942
  • [47] A Fast Visual Odometry and Mapping System for RGB-D Cameras
    Silva, Bruno M. F.
    Goncalves, Luiz M. G.
    2014 2ND BRAZILIAN ROBOTICS SYMPOSIUM (SBR) / 11TH LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS) / 6TH ROBOCONTROL WORKSHOP ON APPLIED ROBOTICS AND AUTOMATION, 2014, : 55 - 60
  • [48] A Novel Hybrid Visual Odometry Using an RGB-D Camera
    Wang, Huiguo
    Wu, Xinyu
    Chen, Zhiheng
    He, Yong
    PROCEEDINGS 2018 33RD YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC), 2018, : 47 - 51
  • [49] Fast Visual Odometry and Mapping from RGB-D Data
    Dryanovski, Ivan
    Valenti, Roberto G.
    Xiao, Jizhong
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 2305 - 2310
  • [50] Sparse Edge Visual Odometry using an RGB-D Camera
    Hsu, Jhih-Lei
    Lin, Huei-Yung
    2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 964 - 969