High-quality Dense SLAM Approach from Deep Learning and Monocular-Inertial Measurements

被引:0
|
作者
Duan, Zhimin [1 ]
Hu, Bowen [1 ]
Yu, Hujie [1 ]
Chen, Chen [1 ]
机构
[1] Natl Univ Def Technol, Changsha 410072, Peoples R China
关键词
3D reconstruction; Depth prediction; IMU constraint; SLAM;
D O I
10.1117/12.2626462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generating high-quality, dense reconstruction of target scenes from monocular images is an essential basis for augmented reality and robotics. However, its apparent shortcomings (such as scale ambiguity) make it challenging to apply monocular 3D reconstruction to the real world. We propose a new monocular inertial dense SLAM method to solve traditional monocular dense SLAM's limitations by combining deep learning and multi-view geometry characteristics. We use the auto-masking static pixels strategy to shield the relatively static pixels in the adjacent image sequence and improve depth estimation accuracy. In addition, this paper combines geometric constraint, photometric constraint, and IMU constraint to propose a globally consistent pose estimation method, which improves camera positioning accuracy and optimizes dense reconstruction quality. The experimental results show that our method has achieved satisfactory results.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Real-time, dense UAV mapping by leveraging monocular depth prediction with monocular-inertial SLAM
    Habib, Yassine
    Papadakis, Panagiotis
    Le Barz, Cedric
    Fagette, Antoine
    Goncalves, Tiago
    Buche, Cedric
    ADVANCED ROBOTICS, 2024, 38 (21) : 1555 - 1566
  • [2] Estimation of Joint Angle From sEMG and Inertial Measurements Based on Deep Learning Approach
    Lobaina Delgado, Alfredo
    Da Rocha, Adson F.
    Suarez Leon, Alexander
    Ruiz-Olaya, Andres
    Montero, Klaus Ribeiro
    Lopez Delis, Alberto
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 700 - 703
  • [3] Using machine learning to select high-quality measurements
    Edmonds, A.
    Brown, D.
    Vinas, L.
    Pagan, S.
    JOURNAL OF INSTRUMENTATION, 2021, 16 (08)
  • [4] High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach
    Pearce, Tim
    Zaki, Mohamed
    Brintrup, Alexandra
    Neely, Andy
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [5] High-Quality Animatable Dynamic Garment Reconstruction From Monocular Videos
    Li, Xiongzheng
    Zhang, Jinsong
    Lai, Yu-Kun
    Yang, Jingyu
    Li, Kun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4243 - 4256
  • [6] Deep Learning: High-quality Imaging through Multicore Fiber
    Wu, Liqing
    Zhao, Jun
    Zhang, Minghai
    Zhang, Yanzhu
    Wang, Xiaoyan
    Chen, Ziyang
    Pu, Jixiong
    CURRENT OPTICS AND PHOTONICS, 2020, 4 (04) : 286 - 292
  • [7] High-Quality Reconstruction for Laplace NMR Based on Deep Learning
    Chen, Bo
    Wu, Liubin
    Cui, Xiaohong
    Lin, Enping
    Cao, Shuohui
    Zhan, Haolin
    Huang, Yuqing
    Yang, Yu
    Chen, Zhong
    ANALYTICAL CHEMISTRY, 2023, 95 (31) : 11596 - 11602
  • [8] Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time
    Huang, Yinghao
    Kaufmann, Manuel
    Aksan, Emre
    Black, Michael J.
    Hilliges, Otmar
    Pons-Moll, Gerard
    SIGGRAPH ASIA'18: SIGGRAPH ASIA 2018 TECHNICAL PAPERS, 2018,
  • [9] A Machine Learning based Approach for Gesture Recognition from Inertial Measurements
    Belgioioso, Giuseppe
    Cenedese, Angelo
    Cirillo, Giuseppe Ilario
    Fraccaroli, Francesco
    Susto, Gian Antonio
    2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 4899 - 4904
  • [10] Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time
    Huang, Yinghao
    Kaufmann, Manuel
    Aksan, Emre
    Black, Michael J.
    Hilliges, Otmar
    Pons-Moll, Gerard
    ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (06):