A Binocular MSCKF-Based Visual Inertial Odometry System Using LK Optical Flow

被引:15
|
作者
Li, Guangqiang [1 ]
Yu, Lei [1 ,2 ]
Fei, Shumin [3 ]
机构
[1] Soochow Univ, Sch Mech & Elect Engn, Suzhou, Peoples R China
[2] Huaiyin Inst Technol, Jiangsu Smart Factory Engn Res Ctr, Huaian, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-state constraint Kalman filter (MSCKF); Visual inertial Odometry (VIO); Pose estimation; Robot operating system (ROS); RECONSTRUCTION SYSTEM; TRACKING; MOTION; FILTER;
D O I
10.1007/s10846-020-01222-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The odometry is an important part of intelligent mobile robots to achieve positioning and navigation functions. At present, the mainstream visual odometry locates only through the visual information obtained by camera sensors. Therefore, in the case of insufficient light, texture missing and camera jitter, the visual odometry is difficult to locate accurately. To solve the problem, we propose a binocular MSCKF-based visual inertial odometry system using Lucas-Kanade (LK) optical flow. Firstly, the Inertial Measurement Unit (IMU) is introduced to overcome the above problems. Moreover, LK optical flow algorithm is utilized to process the visual information obtained by the binocular camera, and MSCKF algorithm is employed to realize the fusion of visual information and inertial information, which improves the accuracy and efficiency of the visual inertial odometry system positioning. Finally, the proposed method is simulated on the European Robotics Challenge (EuRoc) dataset by Robot Operating System (ROS), and compared with two other advanced visual inertial odometry systems, ROVIO and MSCKF-mono. A large number of simulations verify that the proposed method can achieve accurate pose estimation, which is superior to the two existing advanced visual inertial odometry systems.
引用
收藏
页码:1179 / 1194
页数:16
相关论文
共 50 条
  • [41] A Monocular Visual-Inertial Odometry Based on Hybrid Residuals
    Lai, Zhenghong
    Gui, Jianjun
    Xu, Dengke
    Dong, Hongbin
    Deng, Baosong
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3304 - 3311
  • [42] A Stereo-Based Visual-Inertial Odometry for SLAM
    Li, Yong
    Lang, ShiBing
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 594 - 598
  • [43] Visual Odometry Based on the Direct Method and the Inertial Measurement Unit
    Liu Y.
    Zhang Y.
    Rong L.
    Jiang H.
    Deng Y.
    Jiqiren/Robot, 2019, 41 (05): : 683 - 689
  • [44] Stereo Event-Based Visual-Inertial Odometry
    Wang, Kunfeng
    Zhao, Kaichun
    Lu, Wenshuai
    You, Zheng
    SENSORS, 2025, 25 (03)
  • [45] ESVIO: Event-Based Stereo Visual Inertial Odometry
    Chen, Peiyu
    Guan, Weipeng
    Lu, Peng
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3661 - 3668
  • [46] Visual-Inertial Odometry Based on Points and Line Segments
    Qiu, Dezhuo
    Fan, Guishuang
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [47] Invariant Kalman Filter Application to Optical Flow Based Visual Odometry for UAVs
    Goppert, James
    Yantek, Scott
    Hwang, Inseok
    2017 NINTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2017), 2017, : 99 - 104
  • [48] A Dense Optical flow-Based Feature Matching Approach In Visual Odometry
    Chen, Wenzhe
    Fu, Hao
    Shi, Meiping
    Chen, Ying
    2017 NINTH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2017), VOL 2, 2017, : 343 - 348
  • [49] Low Latency Visual Inertial Odometry With On-Sensor Accelerated Optical Flow for Resource-Constrained UAVs
    Kuhne, Jonas
    Magno, Michele
    Benini, Luca
    IEEE SENSORS JOURNAL, 2025, 25 (05) : 7838 - 7847
  • [50] Optical Flow-Based Stereo Visual Odometry With Dynamic Object Detection
    Liu, Yu
    Zhou, Zhiyu
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (06) : 3556 - 3568