A Binocular MSCKF-Based Visual Inertial Odometry System Using LK Optical Flow

被引:15
|
作者
Li, Guangqiang [1 ]
Yu, Lei [1 ,2 ]
Fei, Shumin [3 ]
机构
[1] Soochow Univ, Sch Mech & Elect Engn, Suzhou, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Smart Factory Engn Res Ctr, Huaian, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-state constraint Kalman filter (MSCKF); Visual inertial Odometry (VIO); Pose estimation; Robot operating system (ROS); RECONSTRUCTION SYSTEM; TRACKING; MOTION; FILTER;
D O I
10.1007/s10846-020-01222-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The odometry is an important part of intelligent mobile robots to achieve positioning and navigation functions. At present, the mainstream visual odometry locates only through the visual information obtained by camera sensors. Therefore, in the case of insufficient light, texture missing and camera jitter, the visual odometry is difficult to locate accurately. To solve the problem, we propose a binocular MSCKF-based visual inertial odometry system using Lucas-Kanade (LK) optical flow. Firstly, the Inertial Measurement Unit (IMU) is introduced to overcome the above problems. Moreover, LK optical flow algorithm is utilized to process the visual information obtained by the binocular camera, and MSCKF algorithm is employed to realize the fusion of visual information and inertial information, which improves the accuracy and efficiency of the visual inertial odometry system positioning. Finally, the proposed method is simulated on the European Robotics Challenge (EuRoc) dataset by Robot Operating System (ROS), and compared with two other advanced visual inertial odometry systems, ROVIO and MSCKF-mono. A large number of simulations verify that the proposed method can achieve accurate pose estimation, which is superior to the two existing advanced visual inertial odometry systems.
引用
收藏
页码:1179 / 1194
页数:16
相关论文
共 50 条
  • [1] A Binocular MSCKF-Based Visual Inertial Odometry System Using LK Optical Flow
    Guangqiang Li
    Lei Yu
    Shumin Fei
    Journal of Intelligent & Robotic Systems, 2020, 100 : 1179 - 1194
  • [2] A Lightweight Visual Odometry Based on LK Optical Flow Tracking
    Wang, Xianlun
    Zhou, Yusong
    Yu, Gongxing
    Cui, Yuxia
    APPLIED SCIENCES-BASEL, 2023, 13 (20):
  • [3] Fast stereo visual odometry based on LK optical flow and ORB-SLAM2
    Chuanye Tang
    Xinwen Zhao
    Jianfeng Chen
    Long Chen
    Yazhou Zhou
    Multimedia Systems, 2022, 28 : 2005 - 2014
  • [4] Fast stereo visual odometry based on LK optical flow and ORB-SLAM2
    Tang, Chuanye
    Zhao, Xinwen
    Chen, Jianfeng
    Chen, Long
    Zhou, Yazhou
    MULTIMEDIA SYSTEMS, 2022, 28 (06) : 2005 - 2014
  • [5] Visual odometry using commodity optical flow
    Campbell, J
    Sukthankar, R
    Nourbakhsh, I
    PROCEEDING OF THE NINETEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND THE SIXTEENTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2004, : 1008 - 1009
  • [6] Robust Mono Visual-Inertial Odometry Using Sparse Optical Flow With Edge Detection
    Zeng, Qingxi
    Gao, Chang
    Chen, Zewang
    Jin, Yu
    Kan, Yuchao
    IEEE SENSORS JOURNAL, 2022, 22 (06) : 5260 - 5269
  • [7] A Robust Optical Flow Tracking Method Based On Prediction Model for Visual-Inertial Odometry
    Zhu, Shengnan
    Yang, Shuming
    Hu, Pengyu
    Qu, Xing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 5581 - 5588
  • [8] A Gaussian-Generalized-Inverse-Gaussian Joint-Distribution-Based Adaptive MSCKF for Visual-Inertial Odometry Navigation
    Xue, Chao
    Huang, Yulong
    Zhao, Cheng
    Li, Xiaodong
    Mihaylova, Lyudmila
    Li, Youfu
    Chambers, Jonathon A. A.
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 2307 - 2328
  • [9] Monocular Visual Odometry Based on Depth and Optical Flow Using Deep Learning
    Ban, Xicheng
    Wang, Hongjian
    Chen, Tao
    Wang, Ying
    Xiao, Yao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [10] Visual and inertial odometry based on sensor fusion
    Troncoso, Juan Manuel Reyes
    Correa, Alexander Ceron
    2024 XXIV SYMPOSIUM OF IMAGE, SIGNAL PROCESSING, AND ARTIFICIAL VISION, STSIVA 2024, 2024,