Fast Light-field Disparity Estimation with Multi-disparity-scale Cost Aggregation

被引:25
|
作者
Huang, Zhicong [1 ,2 ]
Hu, Xuemei [1 ]
Xue, Zhou [2 ]
Xu, Weizhu [1 ]
Yue, Tao [1 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing, Peoples R China
[2] ByteDance Inc, Beijing, Peoples R China
关键词
D O I
10.1109/ICCV48922.2021.00626
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light field images contain both angular and spatial information of captured light rays. The rich information of light fields enables straightforward disparity recovery capability but demands high computational cost as well. In this paper, we design a lightweight disparity estimation model with physical-based multi-disparity-scale cost volume aggregation for fast disparity estimation. By introducing a sub-network of edge guidance, we significantly improve the recovery of geometric details near edges and improve the overall performance. We test the proposed model extensively on both synthetic and real-captured datasets, which provide both densely and sparsely sampled light fields. Finally, we significantly reduce computation cost and GPU memory consumption, while achieving comparable performance with state-of-the-art disparity estimation methods for light fields.
引用
收藏
页码:6300 / 6309
页数:10
相关论文
共 50 条
  • [21] Disparity estimation for multi-scale multi-sensor fusion
    SUN Guoliang
    PEI Shanshan
    LONG Qian
    ZHENG Sifa
    YANG Rui
    Journal of Systems Engineering and Electronics, 2024, 35 (02) : 259 - 274
  • [22] A light field depth estimation algorithm by edge disparity extraction
    Ma, Zhuang
    Cen, Zhaofeng
    Li, Xiaotong
    2017 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: OPTOELECTRONIC IMAGING/SPECTROSCOPY AND SIGNAL PROCESSING TECHNOLOGY, 2017, 10620
  • [23] Benchmarking of Several Disparity Estimation Algorithms for Light Field Processing
    Zakeri, Faezeh Sadat
    Baetz, Michel
    Jaschke, Tobias
    Keinert, Joachim
    Chuchvara, Alexandra
    FOURTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2019, 11172
  • [24] ROBUST DISPARITY ESTIMATION ON SPARSE SAMPLED LIGHT FIELD IMAGES
    Li, Yan
    Lafruit, Gauthier
    2017 3DTV CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2017,
  • [25] Enhanced Local Optimization Framework for Light Field Disparity Estimation
    Lourenco, Rui
    Thomaz, Lucas A.
    da Silva, Eduardo A. B.
    de Faria, Sergio M. M.
    2022 10TH EUROPEAN WORKSHOP ON VISUAL INFORMATION PROCESSING (EUVIP), 2022,
  • [26] Multilayer Image Disparity Estimation and Blending for Light Field Cameras
    Chuang, Shih-Chang
    Ding, Jian-Jiun
    Chen, Po-Jen
    2015 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2015, : 1287 - 1290
  • [27] The Accurate Estimation of Disparity Maps from Cross-Scale Reference-Based Light Field
    Zhao, Mandan
    Hao, Xiangyang
    Wu, Gaochang
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC), 2018, : 966 - 971
  • [28] Variational Light Field Analysis for Disparity Estimation and Super-Resolution
    Wanner, Sven
    Goldluecke, Bastian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) : 606 - 619
  • [29] Accurate disparity estimation in light field using ground control points
    Zhu H.
    Wang Q.
    Computational Visual Media, 2016, 2 (2) : 173 - 181
  • [30] Matching entropy based disparity estimation from light field data
    Shi, Ligen
    Liu, Chang
    He, Di
    Zhao, Xing
    Qiu, Jun
    OPTICS EXPRESS, 2023, 31 (04): : 6111 - 6131