OccCasNet: Occlusion-Aware Cascade Cost Volume for Light Field Depth Estimation

被引:1
|
作者
Chao, Wentao [1 ]
Duan, Fuqing [1 ]
Wang, Xuechun [1 ]
Wang, Yingqian [2 ]
Lu, Ke [3 ]
Wang, Guanghui [4 ]
机构
[1] Beijing Normal Univ, Sch Artificial Intelligence, Beijing 100875, Peoples R China
[2] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[3] Univ Chinese Acad Sci, Coll Engn Sci, Beijing 100049, Peoples R China
[4] Toronto Metropolitan Univ, Dept Comp Sci, Toronto, ON M5B 2K3, Canada
基金
中国国家自然科学基金;
关键词
Light field; depth estimation; cascade network; occlusion-aware; cost volume; NETWORK;
D O I
10.1109/TCI.2024.3488563
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Depth estimation using the Light Field (LF) technique is an essential task with a wide range of practical applications. While mainstream approaches based on multi-view stereo techniques can attain exceptional accuracy by creating finer cost volumes, they are resource-intensive, time-consuming, and often overlook occlusion during cost volume construction. To address these issues and strike a better balance between accuracy and efficiency, we propose an occlusion-aware cascade cost volume for LF depth (disparity) estimation. Our cascaded strategy reduces the sampling number while maintaining a constant sampling interval, enabling the construction of a finer cost volume. We also introduce occlusion maps to enhance accuracy in constructing the occlusion-aware cost volume. Specifically, we first generate a coarse disparity map through a coarse disparity estimation network. Then, we warp the sub-aperture images (SAIs) of adjacent views to the center view based on the coarse disparity map to generate occlusion maps for each SAI by photo-consistency constraints. Finally, we seamlessly incorporate occlusion maps into cascade cost volume to construct an occlusion-aware refined cost volume, allowing the refined disparity estimation network to yield a more precise disparity map. Extensive experiments demonstrate the effectiveness of our method. Compared with the state-of-the-art techniques, our method achieves a superior balance between accuracy and efficiency, ranking first in the Q25 metric on the HCI 4D benchmark.
引用
收藏
页码:1680 / 1691
页数:12
相关论文
共 50 条
  • [21] Occlusion-Aware Unsupervised Learning of Depth From 4-D Light Fields
    Jin, Jing
    Hou, Junhui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2216 - 2228
  • [22] Learning Occlusion-aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth Estimation
    Zhou, Zhengming
    Dong, Qiulei
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6386 - 6395
  • [23] Learning occlusion-aware view synthesis for light fields
    Navarro, J.
    Sabater, N.
    PATTERN ANALYSIS AND APPLICATIONS, 2021, 24 (03) : 1319 - 1334
  • [24] Learning occlusion-aware view synthesis for light fields
    J. Navarro
    N. Sabater
    Pattern Analysis and Applications, 2021, 24 : 1319 - 1334
  • [25] Robust Light Field Depth Estimation Using Occlusion-Noise Aware Data Costs
    Williem
    Park, In Kyu
    Lee, Kyoung Mu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) : 2484 - 2497
  • [26] DEPTH ESTIMATION WITH OCCLUSION PREDICTION IN LIGHT FIELD IMAGES
    Ghorai, Mrinmoy
    Munteanu, Adrian
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1049 - 1053
  • [27] Occlusion-Aware Depth Map Coding Optimization Using Allowable Depth Map Distortions
    Gao, Pan
    Smolic, Aljosa
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (11) : 5266 - 5280
  • [28] Accurate light field depth estimation under occlusion
    Liu, Yuxuan
    Aleksandrov, Mitko
    Hu, Zhihua
    Meng, Yan
    Zhang, Li
    Zlatanova, Sisi
    Ai, Haibin
    Tao, Pengjie
    PATTERN RECOGNITION, 2023, 138
  • [29] Light Field Depth Estimation based on Occlusion Optimization
    Zhang, Long
    Deng, Huiping
    Xiang, Sen
    Li, Shuang
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1635 - 1639
  • [30] Occlusion-Aware Amodal Depth Estimation for Enhancing 3D Reconstruction From a Single Image
    Jo, Seong-Uk
    Lee, Du Yeol
    Rhee, Chae Eun
    IEEE ACCESS, 2024, 12 : 106524 - 106536