Multi range Real-time depth inference from a monocular stabilized footage using a Fully Convolutional Neural Network

被引:0
|
作者
Pinard, Clement [1 ,2 ]
Chevalley, Laure [1 ]
Manzanera, Antoine [2 ]
Filliat, David [2 ]
机构
[1] Parrot, Paris, France
[2] Univ Paris Saclay, ENSTA ParisTech, U2IS, Palaiseau, France
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a neural network architecture for depth map inference from monocular stabilized videos with application to UAV videos in rigid scenes. Training is based on a novel synthetic dataset for navigation that mimics aerial footage from gimbal stabilized monocular camera in rigid scenes. Based on this network, we propose a multi-range architecture for unconstrained UAV flight, leveraging flight data from sensors to make accurate depth maps for uncluttered outdoor environment. We try our algorithm on both synthetic scenes and real UAV flight data. Quantitative results are given for synthetic scenes with a slightly noisy orientation, and show that our multi-range architecture improves depth inference. Along with this article is a video that present our results more thoroughly.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation
    Liu, Jun
    Li, Qing
    Cao, Rui
    Tang, Wenming
    Qiu, Guoping
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 (166) : 255 - 267
  • [2] Drone Detection and Tracking using Deep Convolutional Neural Networks from Real-time CCTV Footage
    Allmamun, Md
    Akter, Fahima
    Talukdar, Muhammad Borhan Uddin
    Chakraborty, Sovon
    Uddin, Jia
    IEIE Transactions on Smart Processing and Computing, 2024, 13 (04): : 313 - 321
  • [3] Transfer learning for real-time crater detection on asteroids using a Fully Convolutional Neural Network
    Latorre, F.
    Spiller, D.
    Sasidharan, S. T.
    Basheer, S.
    Curti, F.
    ICARUS, 2023, 394
  • [4] Real-time Monocular Depth Estimation with Extremely Light-Weight Neural Network
    Chiu, Mian-Jhong
    Chiu, Wei-Chen
    Chen, Hua-Tsung
    Chuang, Jen-Hui
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7050 - 7057
  • [5] Depth estimation for a road scene using a monocular image sequence based on fully convolutional neural network
    Wang, Haixia
    Sun, Yehao
    Zhang, Zhiguo
    Lu, Xiao
    Sheng, Chunyang
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03)
  • [6] Real-Time Head Orientation from a Monocular Camera Using Deep Neural Network
    Ahn, Byungtae
    Park, Jaesik
    Kweon, In So
    COMPUTER VISION - ACCV 2014, PT III, 2015, 9005 : 82 - 96
  • [7] REAL-TIME OBJECT DETECTION BY A MULTI-FEATURE FULLY CONVOLUTIONAL NETWORK
    Guo, Yajing
    Guo, Xiaoqiang
    Jiang, Zhuqing
    Men, Aidong
    Zhou, Yun
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 670 - 674
  • [8] Real-Time Age Detection Using a Convolutional Neural Network
    Sithungu, Siphesihle
    Van der Haar, Dustin
    BUSINESS INFORMATION SYSTEMS, BIS 2019, PT II, 2019, 354 : 245 - 256
  • [9] Monocular depth estimation with geometrical guidance using a multi-level convolutional neural network
    Amirkolaee, Hamed Amini
    Arefi, Hossein
    APPLIED SOFT COMPUTING, 2019, 84
  • [10] OptiDepthNet: A Real-Time Unsupervised Monocular Depth Estimation Network
    Wei, Feng
    Yin, XingHui
    Shen, Jie
    Wang, HuiBin
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 128 (04) : 2831 - 2846