From Local Understanding to Global Regression in Monocular Visual Odometry

被引:6
|
作者
Esfahani, Mandi Abolfazli [1 ]
Wu, Keyu [1 ]
Yuan, Shenghai [1 ]
Wang, Han [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
关键词
Visual odometry; deep learning; convolutional neural network (CNN); simultaneous localization and mapping (SLAM); classification; regression;
D O I
10.1142/S0218001420550022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The most significant part of any autonomous intelligent robot is the localization module that gives the robot knowledge about its position and orientation. This knowledge assists the robot to move to the location of its desired goal and complete its task. Visual Odometry (VO) measures the displacement of the robots' camera in consecutive frames which results in the estimation of the robot position and orientation. Deep Learning, nowadays, helps to learn rich and informative features for the problem of VO to estimate frame-by-frame camera movement. Recent Deep Learning-based VO methods train an end-by-end network to solve VO as a regression problem directly without visualizing and sensing the label of training data in the training procedure. In this paper, a new approach to train Convolutional Neural Networks (CNNs) for the regression problems, such as VO, is proposed. The proposed method first changes the problem to a classification problem to learn different subspaces with similar observations. After solving the classification problem, the problem converts to the original regression problem to solve using the knowledge achieved by solving the classification problem. This approach helps CNN to solve regression problem globally in a local domain learned in the classification step, and improves the performance of the regression module for approximately 10%.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Inertial Monocular Visual Odometry Based on RUPF Algorithm
    Hou, Juanrou
    Wang, Zhanqing
    Zhang, Yanshun
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 3885 - 3891
  • [42] Improving Monocular Visual Odometry Using Learned Depth
    Sun, Libo
    Yin, Wei
    Xie, Enze
    Li, Zhengrong
    Sun, Changming
    Shen, Chunhua
    IEEE TRANSACTIONS ON ROBOTICS, 2022, 38 (05) : 3173 - 3186
  • [43] Monocular Visual Odometry based on Inverse Perspective Mapping
    Cao Yu
    Feng Ying
    Yang Yun-tao
    Chen Yun-jin
    Lei Bing
    Zhao Li-shuang
    INTERNATIONAL SYMPOSIUM ON PHOTOELECTRONIC DETECTION AND IMAGING 2011: ADVANCES IN IMAGING DETECTORS AND APPLICATIONS, 2011, 8194
  • [44] MONOCULAR VISUAL ODOMETRY FOR IN-PIPE INSPECTION ROBOT
    Kadir, Herdawatie Abdul
    Arshad, M. R.
    Aghdam, Hamed Habibi
    Zaman, Munir
    JURNAL TEKNOLOGI, 2015, 74 (09): : 35 - 40
  • [45] Monocular Visual Odometry Initialization With Points and Line Segments
    Zhou, Hang
    Fan, Haiyan
    Peng, Keju
    Fan, Weihong
    Zhou, Dongxiang
    Liu, Yunhui
    IEEE ACCESS, 2019, 7 : 73120 - 73130
  • [46] Parallel, Real-Time Monocular Visual Odometry
    Song, Shiyu
    Chandraker, Manmohan
    Guest, Clark C.
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 4698 - 4705
  • [47] Monocular visual odometry based on improved Census transform
    Lin Z.-W.
    Li Q.-M.
    Wang X.-Y.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2021, 55 (08): : 1500 - 1509
  • [48] A monocular visual inertial odometry based on structural features
    Yan L.
    Li C.
    Xu B.
    Xia Y.
    Xiao B.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (10): : 3207 - 3217
  • [49] Monocular Visual Odometry for Robot Localization in LNG Pipes
    Hansen, Peter
    Alismail, Hatem
    Rander, Peter
    Browning, Brett
    2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [50] INS Assisted Monocular Visual Odometry for Aerial Vehicles
    Zhang, Ji
    Singh, Sanjiv
    FIELD AND SERVICE ROBOTICS, 2015, 105 : 183 - 197