High-quality Dense SLAM Approach from Deep Learning and Monocular-Inertial Measurements

被引:0
|
作者
Duan, Zhimin [1 ]
Hu, Bowen [1 ]
Yu, Hujie [1 ]
Chen, Chen [1 ]
机构
[1] Natl Univ Def Technol, Changsha 410072, Peoples R China
关键词
3D reconstruction; Depth prediction; IMU constraint; SLAM;
D O I
10.1117/12.2626462
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generating high-quality, dense reconstruction of target scenes from monocular images is an essential basis for augmented reality and robotics. However, its apparent shortcomings (such as scale ambiguity) make it challenging to apply monocular 3D reconstruction to the real world. We propose a new monocular inertial dense SLAM method to solve traditional monocular dense SLAM's limitations by combining deep learning and multi-view geometry characteristics. We use the auto-masking static pixels strategy to shield the relatively static pixels in the adjacent image sequence and improve depth estimation accuracy. In addition, this paper combines geometric constraint, photometric constraint, and IMU constraint to propose a globally consistent pose estimation method, which improves camera positioning accuracy and optimizes dense reconstruction quality. The experimental results show that our method has achieved satisfactory results.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Deep-learning enhanced high-quality imaging in metalens-integrated camera
    Zhang, Yanxiang
    Wu, Yue
    Huang, Chunyu
    Zhou, Zi-wen
    Li, Muyang
    Zhang, Zaichen
    Chen, Ji
    OPTICS LETTERS, 2024, 49 (10) : 2853 - 2856
  • [22] CleanRL: High-quality Single-file Implementations of Deep Reinforcement Learning Algorithms
    Huang, Shengyi
    Julien Dossa, Rousslan Fernand
    Ye, Chang
    Braga, Jeff
    Chakraborty, Dipam
    Mehta, Kinal
    Araújo, João G.M.
    Journal of Machine Learning Research, 2022, 23
  • [23] A novel deep learning-based approach for reconstruction of historical long-term high-quality gridded meteorological dataset
    Jeong, Yookyung
    Kim, Dongkyun
    Byun, Kyuhyun
    JOURNAL OF HYDROLOGY, 2025, 654
  • [24] Modeling of optical scattering from topographic surface measurements of high-quality mirrors
    Akutsu, Tomotada
    Yamamoto, Hiroaki
    APPLIED OPTICS, 2025, 64 (08) : 1995 - 2001
  • [25] Merging Full-Spectrum and Fragment Ion Intensity Predictions from Deep Learning for High-Quality Spectral Libraries
    Chan, Chak Ming Jerry
    Lam, Henry
    JOURNAL OF PROTEOME RESEARCH, 2023, 22 (12) : 3692 - 3702
  • [26] A deep learning method for high-quality ultra-fast CT image reconstruction from sparsely sampled projections
    Khodajou-Chokami, Hamidreza
    Hosseini, Seyed Abolfazl
    Ay, Mohammad Reza
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2022, 1029
  • [27] Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos
    Bai, Ziqian
    Tan, Feitong
    Huang, Zeng
    Sarkar, Kripasindhu
    Tang, Danhang
    Qiu, Di
    Meka, Abhimitra
    Du, Ruofei
    Dou, Mingsong
    Orts-Escolano, Sergio
    Pandey, Rohit
    Tan, Ping
    Beeler, Thabo
    Fanello, Sean
    Zhang, Yinda
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16890 - 16900
  • [28] Finernet: A Coarse-to-Fine Approach to Learning High-Quality Implicit Surface Reconstruction
    Mei, Dan
    Wang, Xiaogang
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 147 - 158
  • [29] New High-quality Strong Lens Candidates with Deep Learning in the Kilo-Degree Survey
    Li, R.
    Napolitano, N. R.
    Tortora, C.
    Spiniello, C.
    Koopmans, L. V. E.
    Huang, Z.
    Roy, N.
    Vernardos, G.
    Chatterjee, S.
    Giblin, B.
    Getman, F.
    Radovich, M.
    Covone, G.
    Kuijken, K.
    ASTROPHYSICAL JOURNAL, 2020, 899 (01):
  • [30] Learning Multi-Scale Deep Image Prior for High-Quality Unsupervised Image Denoising
    Jiang, Hao
    Zhang, Qing
    Nie, Yongwei
    Zhu, Lei
    Zheng, Wei-Shi
    COMPUTER GRAPHICS FORUM, 2022, 41 (07) : 323 - 334