A Binocular MSCKF-Based Visual Inertial Odometry System Using LK Optical Flow

被引:15
|
作者
Li, Guangqiang [1 ]
Yu, Lei [1 ,2 ]
Fei, Shumin [3 ]
机构
[1] Soochow Univ, Sch Mech & Elect Engn, Suzhou, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Smart Factory Engn Res Ctr, Huaian, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-state constraint Kalman filter (MSCKF); Visual inertial Odometry (VIO); Pose estimation; Robot operating system (ROS); RECONSTRUCTION SYSTEM; TRACKING; MOTION; FILTER;
D O I
10.1007/s10846-020-01222-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The odometry is an important part of intelligent mobile robots to achieve positioning and navigation functions. At present, the mainstream visual odometry locates only through the visual information obtained by camera sensors. Therefore, in the case of insufficient light, texture missing and camera jitter, the visual odometry is difficult to locate accurately. To solve the problem, we propose a binocular MSCKF-based visual inertial odometry system using Lucas-Kanade (LK) optical flow. Firstly, the Inertial Measurement Unit (IMU) is introduced to overcome the above problems. Moreover, LK optical flow algorithm is utilized to process the visual information obtained by the binocular camera, and MSCKF algorithm is employed to realize the fusion of visual information and inertial information, which improves the accuracy and efficiency of the visual inertial odometry system positioning. Finally, the proposed method is simulated on the European Robotics Challenge (EuRoc) dataset by Robot Operating System (ROS), and compared with two other advanced visual inertial odometry systems, ROVIO and MSCKF-mono. A large number of simulations verify that the proposed method can achieve accurate pose estimation, which is superior to the two existing advanced visual inertial odometry systems.
引用
收藏
页码:1179 / 1194
页数:16
相关论文
共 50 条
  • [11] Binocular vision/inertial odometer algorithm based on interactive Multi-model MSCKF method
    Wang L.
    Cheng X.
    Li J.
    Wang L.
    Zhongguo Guanxing Jishu Xuebao/Journal of Chinese Inertial Technology, 2021, 29 (02): : 221 - 228and236
  • [12] Event-based Visual Inertial Odometry
    Zhu, Alex Zihao
    Atanasov, Nikolay
    Daniilidis, Kostas
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5816 - 5824
  • [13] Visual Odometry based on binocular Catadioptric Panoramic Camera
    Zhang Yu
    Xu Xiping
    Lv Yaowen
    Zhang Kailin
    AOPC 2021: NOVEL TECHNOLOGIES AND INSTRUMENTS FOR ASTRONOMICAL MULTI-BAND OBSERVATIONS, 2021, 12069
  • [14] Leveraging Deep Learning for Visual Odometry Using Optical Flow
    Pandey, Tejas
    Pena, Dexmont
    Byrne, Jonathan
    Moloney, David
    SENSORS, 2021, 21 (04) : 1 - 13
  • [15] Robust visual odometry using sparse optical flow network
    Liu, Qiang
    Chen, Baojia
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 116
  • [16] A Combined Visual-Inertial Navigation System of MSCKF And EKF-SLAM
    Li, Jian
    Li, Qing
    Cheng, Nong
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [17] Monocular Visual Odometry Based on Optical Flow and Feature Matching
    Cheng Chuanqi
    Hao Xiangyang
    Zhang Zhenjie
    Zhao Mandan
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 4554 - 4558
  • [18] Fusion of visual odometry and inertial navigation system on a smartphone
    Tomazic, Simon
    Skrjanc, Igor
    COMPUTERS IN INDUSTRY, 2015, 74 : 119 - 134
  • [19] GNSS Reconstrainted Visual-Inertial Odometry System Using Factor Graphs
    Chen, Yu
    Xu, Bo
    Wang, Bin
    Na, Jiaming
    Yang, Pei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [20] GNSS Reconstrainted Visual-Inertial Odometry System Using Factor Graphs
    Chen, Yu
    Xu, Bo
    Wang, Bin
    Na, Jiaming
    Yang, Pei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20