A study on depth map generation using a light field camera and a monocular RGB camera based on deep learning

被引:0
|
作者
Takamatsu, Makoto [1 ]
Hasegawa, Makoto [1 ]
机构
[1] Tokyo Denki Univ, Tokyo, Japan
关键词
Light field camera; depth map; Depth from Focus; conditional generative adversarial network; and pix2pix;
D O I
10.1117/12.2542653
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
A depth map and an RGB image taken by a light field camera for training data are arranged in a dataset pair; the datasets are learnt through a deep learning method called pix2pix, which is a type of conditional generative adversarial network. We can generate depth maps using only a monocular mobile camera without the light field camera based on our proposed method. Low accuracy on depth is a technical issue for the light field camera; however, the proposed method improves the depth accuracy due to the generalization ability of neural networks.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Method of Using RealSense Camera to Estimate the Depth Map of Any Monocular Camera
    Tu, Li-fen
    Peng, Qi
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2021, 2021
  • [2] Depth Image Inpainting for RGB-D Camera Based on Light Field EPI
    Yang, Xinxin
    Sun, Jize
    Diao, Weimin
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC), 2018, : 214 - 219
  • [3] Precision mapping through an RGB-Depth camera and deep learning
    Petrakis, Georgios
    Partsinevelos, Panagiotis
    25TH AGILE CONFERENCE ON GEOGRAPHIC INFORMATION SCIENCE ARTIFICIAL INTELLIGENCE IN THE SERVICE OF GEOSPATIAL TECHNOLOGIES, 2022, 3
  • [4] Facial Expression Recognition Using Depth Map Estimation of Light Field Camera
    Shen, Tak-Wai
    Fu, Hong
    Chen, Junkai
    Yu, W. K.
    Lau, C. Y.
    Lo, W. L.
    Chi, Zheru
    2016 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC), 2016,
  • [5] SDF-SLAM: A Deep Learning Based Highly Accurate SLAM Using Monocular Camera Aiming at Indoor Map Reconstruction With Semantic and Depth Fusion
    Yang, Chen
    Chen, Qi
    Yang, Yaoyao
    Zhang, Jingyu
    Wu, Minshun
    Mei, Kuizhi
    IEEE ACCESS, 2022, 10 : 10259 - 10272
  • [6] Accurate Depth Map Estimation from a Lenslet Light Field Camera
    Jeon, Hae-Gon
    Park, Jaesik
    Choe, Gyeongrn
    Park, Jinsun
    Bok, Yunsu
    Tai, Yu-Wing
    Kweon, In So
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1547 - 1555
  • [7] External mask based depth and light field camera
    Reddy, Dikpal
    Bai, Jiamin
    Ramamoorthi, Ravi
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, : 37 - 44
  • [8] A Machine Learning Based Method for Object Detection and Localization Using a Monocular RGB Camera Equipped Drone
    Javaid, Abdulrahman
    Syed, Miswar Akhtar
    Baroudi, Uthman
    2023 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2023, : 144 - 149
  • [9] Depth Map Building and Enhancement using a Monocular Camera, Shape Priors and Variational Methods
    Diaz, Andres
    Paz, Lina
    Pinies, Pedro
    Caicedo, Eduardo
    COMPUTACION Y SISTEMAS, 2020, 24 (02): : 781 - 796
  • [10] Deep Learning based Command Pointing direction estimation using a single RGB Camera
    Jaiswal, Shruti
    Mishra, Pratyush
    Nandi, G. C.
    2018 5TH IEEE UTTAR PRADESH SECTION INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER ENGINEERING (UPCON), 2018, : 724 - 729