Multi range Real-time depth inference from a monocular stabilized footage using a Fully Convolutional Neural Network

被引:0
|
作者
Pinard, Clement [1 ,2 ]
Chevalley, Laure [1 ]
Manzanera, Antoine [2 ]
Filliat, David [2 ]
机构
[1] Parrot, Paris, France
[2] Univ Paris Saclay, ENSTA ParisTech, U2IS, Palaiseau, France
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a neural network architecture for depth map inference from monocular stabilized videos with application to UAV videos in rigid scenes. Training is based on a novel synthetic dataset for navigation that mimics aerial footage from gimbal stabilized monocular camera in rigid scenes. Based on this network, we propose a multi-range architecture for unconstrained UAV flight, leveraging flight data from sensors to make accurate depth maps for uncluttered outdoor environment. We try our algorithm on both synthetic scenes and real UAV flight data. Quantitative results are given for synthetic scenes with a slightly noisy orientation, and show that our multi-range architecture improves depth inference. Along with this article is a video that present our results more thoroughly.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Real-time Earthquake Detection using Convolutional Neural Network and Social Data
    Van Quan Nguyen
    Yang, Hyung-Jeong
    Kim, Kyungbaek
    Oh, A-Ran
    2017 IEEE THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2017), 2017, : 154 - 157
  • [32] Real-Time Road Crack Mapping Using an Optimized Convolutional Neural Network
    Naddaf-Sh, M-Mahdi
    Hosseini, SeyedSaeid
    Zhang, Jing
    Brake, Nicholas A.
    Zargarzadeh, Hassan
    COMPLEXITY, 2019, 2019
  • [33] Real-Time Tool Localization for Laparoscopic Surgery Using Convolutional Neural Network
    Benavides, Diego
    Cisnal, Ana
    Fonturbel, Carlos
    de la Fuente, Eusebio
    Fraile, Juan Carlos
    SENSORS, 2024, 24 (13)
  • [34] Generating Multi-Depth 3D Holograms Using a Fully Convolutional Neural Network
    Yan, Xingpeng
    Liu, Xinlei
    Li, Jiaqi
    Zhang, Yanan
    Chang, Hebin
    Jing, Tao
    Hu, Hairong
    Qu, Qiang
    Wang, Xi
    Jiang, Xiaoyu
    ADVANCED SCIENCE, 2024, 11 (28)
  • [35] High Utilization Energy-Aware Real-Time Inference Deep Convolutional Neural Network Accelerator
    Lin, Kuan-Ting
    Chiu, Ching-Te
    Chang, Jheng-Yi
    Hsiao, Shan-Chien
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [36] EMTNet: efficient mobile transformer network for real-time monocular depth estimation
    Long Yan
    Fuyang Yu
    Chao Dong
    Pattern Analysis and Applications, 2023, 26 : 1833 - 1846
  • [37] Real-Time Dense Monocular SLAM With Online Adapted Depth Prediction Network
    Luo, Hongcheng
    Gao, Yang
    Wu, Yuhao
    Liao, Chunyuan
    Yang, Xin
    Cheng, Kwang-Ting
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (02) : 470 - 483
  • [38] EMTNet: efficient mobile transformer network for real-time monocular depth estimation
    Yan, Long
    Yu, Fuyang
    Dong, Chao
    PATTERN ANALYSIS AND APPLICATIONS, 2023, 26 (04) : 1833 - 1846
  • [39] REAL-TIME PARAMETER INFERENCE OF NONLINEAR BLUFF-BODY-STABILIZED FLAME MODELS USING BAYESIAN NEURAL NETWORK ENSEMBLES
    Croci, Maximilian L.
    Sengupta, Ushnish
    Ekici, Ekrem
    Juniper, Matthew P.
    PROCEEDINGS OF ASME TURBO EXPO 2023: TURBOMACHINERY TECHNICAL CONFERENCE AND EXPOSITION, GT2023, VOL 3A, 2023,
  • [40] A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement
    Tan, Ke
    Wang, DeLiang
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3229 - 3233