A Binocular MSCKF-Based Visual Inertial Odometry System Using LK Optical Flow

被引:15
|
作者
Li, Guangqiang [1 ]
Yu, Lei [1 ,2 ]
Fei, Shumin [3 ]
机构
[1] Soochow Univ, Sch Mech & Elect Engn, Suzhou, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Smart Factory Engn Res Ctr, Huaian, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-state constraint Kalman filter (MSCKF); Visual inertial Odometry (VIO); Pose estimation; Robot operating system (ROS); RECONSTRUCTION SYSTEM; TRACKING; MOTION; FILTER;
D O I
10.1007/s10846-020-01222-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The odometry is an important part of intelligent mobile robots to achieve positioning and navigation functions. At present, the mainstream visual odometry locates only through the visual information obtained by camera sensors. Therefore, in the case of insufficient light, texture missing and camera jitter, the visual odometry is difficult to locate accurately. To solve the problem, we propose a binocular MSCKF-based visual inertial odometry system using Lucas-Kanade (LK) optical flow. Firstly, the Inertial Measurement Unit (IMU) is introduced to overcome the above problems. Moreover, LK optical flow algorithm is utilized to process the visual information obtained by the binocular camera, and MSCKF algorithm is employed to realize the fusion of visual information and inertial information, which improves the accuracy and efficiency of the visual inertial odometry system positioning. Finally, the proposed method is simulated on the European Robotics Challenge (EuRoc) dataset by Robot Operating System (ROS), and compared with two other advanced visual inertial odometry systems, ROVIO and MSCKF-mono. A large number of simulations verify that the proposed method can achieve accurate pose estimation, which is superior to the two existing advanced visual inertial odometry systems.
引用
收藏
页码:1179 / 1194
页数:16
相关论文
共 50 条
  • [31] Flowdometry: An Optical Flow and Deep Learning Based Approach to Visual Odometry
    Muller, Peter
    Savakis, Andreas
    2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 624 - 631
  • [32] A Visual Feature Mismatch Detection Algorithm for Optical Flow-Based Visual Odometry
    Li, Ruichen
    Shen, Han
    Wang, Linan
    Liu, Congyi
    Yi, Xiaojian
    UNMANNED SYSTEMS, 2024,
  • [33] Metric Visual-Inertial Navigation System Using Single Optical Flow Feature
    Omari, Sammy
    Ducard, Guillaume
    2013 EUROPEAN CONTROL CONFERENCE (ECC), 2013, : 1310 - 1316
  • [34] A Novel Cross-Attention-Based Pedestrian Visual-Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow
    Pajula, Ilari
    Joswig, Niclas
    Morrison, Aiden
    Sokolova, Nadia
    Ruotsalainen, Laura
    IEEE Journal on Indoor and Seamless Positioning and Navigation, 2024, 2 : 25 - 35
  • [35] Visual-Inertial Combined Odometry System for Aerial Vehicles
    Zhang, Ji
    Singh, Sanjiv
    JOURNAL OF FIELD ROBOTICS, 2015, 32 (08) : 1043 - 1055
  • [36] Perception in the Dark; Development of a ToF Visual Inertial Odometry System
    Chen, Shengyang
    Chang, Ching-Wei
    Wen, Chih-Yung
    SENSORS, 2020, 20 (05)
  • [37] Comparison of Visual Inertial Odometry using FlightGoggles Simulator for UAV
    Lee, Eungchang Mason
    Wee, Inhwan
    Kim, Taeyeon
    Shim, David Hyunchul
    2019 19TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2019), 2019, : 1166 - 1169
  • [38] Using Vanishing Points to Improve Visual-Inertial Odometry
    Camposeco, Federico
    Pollefeys, Marc
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 5219 - 5225
  • [39] Relative motion estimation using visual–inertial optical flow
    Hongsheng He
    Yan Li
    Jindong Tan
    Autonomous Robots, 2018, 42 : 615 - 629
  • [40] Evaluating Visual Inertial Odometry Using the Windy Forest Dataset
    Schofield, Sam
    Bainbridge-Smith, Andrew
    Green, Richard
    PROCEEDINGS OF THE 2021 36TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2021,