Real-time Onboard 6DoF Localization of an Indoor MAV in Degraded Visual Environments Using a RGB-D Camera

被引:0
|
作者
Fang, Zheng [1 ]
Scherer, Sebastian [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110189, Peoples R China
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time and reliable localization is a prerequisite for autonomously performing high-level tasks with micro aerial vehicles(MAVs). Nowadays, most existing methods use vision system for 6DoF pose estimation, which can not work in degraded visual environments. This paper presents an onboard 6DoF pose estimation method for an indoor MAV in challenging GPS-denied degraded visual environments by using a RGB-D camera. In our system, depth images are mainly used for odometry estimation and localization. First, a fast and robust relative pose estimation (6DoF Odometry) method is proposed, which uses the range rate constraint equation and photometric error metric to get the frame-to-frame transform. Then, an absolute pose estimation (6DoF Localization) method is proposed to locate the MAV in a given 3D global map by using a particle filter. The whole localization system can run in real-time on an embedded computer with low CPU usage. We demonstrate the effectiveness of our system in extensive real environments on a customized MAV platform. The experimental results show that our localization system can robustly and accurately locate the robot in various practical challenging environments.
引用
收藏
页码:5253 / 5259
页数:7
相关论文
共 50 条
  • [21] Real-Time Geometry, Albedo, and Motion Reconstruction Using a Single RGB-D Camera
    Guo, Kaiwen
    Xu, Feng
    Yu, Tao
    Liu, Xiaoyang
    Dai, Qionghai
    Liu, Yebin
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (03):
  • [22] Real-time Lane Marker Detection Using Template Matching with RGB-D Camera
    Cong Hoang Quach
    Van Lien Tran
    Duy Hung Nguyen
    Viet Thang Nguyen
    Minh Trien Pham
    Manh Duong Phung
    PROCEEDINGS OF 2018 2ND INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN SIGNAL PROCESSING, TELECOMMUNICATIONS & COMPUTING (SIGTELCOM 2018), 2018, : 152 - 157
  • [23] Optimized Method for Real-time Texture Reconstruction with RGB-D Camera
    Yonghong Hou
    Hang Li
    Chuankun Liu
    Liang Zhang
    Transactions of Tianjin University, 2017, 23 (05) : 493 - 500
  • [24] Real-Time Moving Objects Segmentation based on RGB-D camera
    Zhu, Rui
    Zhao, Yongjia
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [25] Optimized Method for Real-time Texture Reconstruction with RGB-D Camera
    Hou Y.
    Li H.
    Liu C.
    Zhang L.
    Transactions of Tianjin University, 2017, 23 (5) : 493 - 500
  • [26] Real-time obstacle perception method for UAVs with an RGB-D camera in low-light environments
    Wang, Hua
    Wang, Hao
    Liu, Yan-Jun
    Liu, Lei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (03)
  • [27] Real-time motion removal based on point correlations for RGB-D SLAM in indoor dynamic environments
    Kesai Wang
    Xifan Yao
    Nanfeng Ma
    Xuan Jing
    Neural Computing and Applications, 2023, 35 : 8707 - 8722
  • [28] Real-time motion removal based on point correlations for RGB-D SLAM in indoor dynamic environments
    Wang, Kesai
    Yao, Xifan
    Ma, Nanfeng
    Jing, Xuan
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (12): : 8707 - 8722
  • [29] Visual Camera Re-Localization From RGB and RGB-D Images Using DSAC
    Brachmann, Eric
    Rother, Carsten
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5847 - 5865
  • [30] Time-efficient Dense Visual 12-DoF State Estimator using RGB-D Camera
    Kim, Changhyeon
    Lee, Sangil
    Kim, Pyojin
    Kim, H. Jin
    2017 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS AND AMBIENT INTELLIGENCE (URAI), 2017, : 130 - 135