From Local Understanding to Global Regression in Monocular Visual Odometry

被引:6
|
作者
Esfahani, Mandi Abolfazli [1 ]
Wu, Keyu [1 ]
Yuan, Shenghai [1 ]
Wang, Han [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
关键词
Visual odometry; deep learning; convolutional neural network (CNN); simultaneous localization and mapping (SLAM); classification; regression;
D O I
10.1142/S0218001420550022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most significant part of any autonomous intelligent robot is the localization module that gives the robot knowledge about its position and orientation. This knowledge assists the robot to move to the location of its desired goal and complete its task. Visual Odometry (VO) measures the displacement of the robots' camera in consecutive frames which results in the estimation of the robot position and orientation. Deep Learning, nowadays, helps to learn rich and informative features for the problem of VO to estimate frame-by-frame camera movement. Recent Deep Learning-based VO methods train an end-by-end network to solve VO as a regression problem directly without visualizing and sensing the label of training data in the training procedure. In this paper, a new approach to train Convolutional Neural Networks (CNNs) for the regression problems, such as VO, is proposed. The proposed method first changes the problem to a classification problem to learn different subspaces with similar observations. After solving the classification problem, the problem converts to the original regression problem to solve using the knowledge achieved by solving the classification problem. This approach helps CNN to solve regression problem globally in a local domain learned in the classification step, and improves the performance of the regression module for approximately 10%.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] STMVO: biologically inspired monocular visual odometry
    Li, Yangming
    Zhang, Jian
    Li, Shuai
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (06): : 215 - 225
  • [32] Deep Online Correction for Monocular Visual Odometry
    Zhang, Jiaxin
    Sui, Wei
    Wang, Xinggang
    Meng, Wenming
    Zhu, Hongmei
    Zhang, Qian
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 14396 - 14402
  • [33] A Global Occlusion-Aware Approach to Self-Supervised Monocular Visual Odometry
    Lu, Yao
    Xu, Xiaoli
    Ding, Mingyu
    Lu, Zhiwu
    Xiang, Tao
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2260 - 2268
  • [34] Eliminating Scale Ambiguity of Unsupervised Monocular Visual Odometry
    Wang, Zhongyi
    Shen, Mengjiao
    Chen, Qijun
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 9743 - 9764
  • [35] Unsupervised Monocular Visual-inertial Odometry Network
    Wei, Peng
    Hua, Guoliang
    Huang, Weibo
    Meng, Fanyang
    Liu, Hong
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2347 - 2354
  • [36] A Novel Approach to Improve the Precision of Monocular Visual Odometry
    Xiao, Chen
    Zhu, Xiaorui
    Feng, Wei
    Ou, Yongsheng
    2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 392 - 397
  • [37] Monocular Visual-Inertial Odometry for Agricultural Environments
    Song, Kaiyu
    Li, Jingtao
    Qiu, Run
    Yang, Gaidi
    IEEE Access, 2022, 10 : 103975 - 103986
  • [38] Monocular Visual Odometry Based on Trifocal Tensor Constraint
    Chen, Y. J.
    Yang, G. L.
    Jiang, Y. X.
    Liu, X. Y.
    2018 INTERNATIONAL CONFERENCE ON CONTROL ENGINEERING AND ARTIFICIAL INTELLIGENCE (CCEAI 2018), 2018, 976
  • [39] Semi-Dense Visual Odometry for a Monocular Camera
    Engel, Jakob
    Sturm, Juergen
    Cremers, Daniel
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1449 - 1456
  • [40] Monocular Visual Odometry Using Fisheye Lens Cameras
    Aguiar, Andre
    Santos, Filipe
    Santos, Luis
    Sousa, Armando
    PROGRESS IN ARTIFICIAL INTELLIGENCE, PT II, 2019, 11805 : 319 - 330