Depth Estimation From Light Field Using Graph-Based Structure-Aware Analysis

被引:29
|
作者
Zhang, Yuchen [1 ]
Dai, Wenrui [2 ]
Xu, Mingxing [1 ]
Zou, Junni [2 ]
Zhang, Xiaopeng [3 ]
Xiong, Hongkai [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
[3] Huawei Technol Co Ltd, Noahs Ark Lab, Shanghai 201206, Peoples R China
基金
中国国家自然科学基金;
关键词
Light field; depth map; graph spectral analysis; graph Laplacian matrix; FOURIER-TRANSFORM;
D O I
10.1109/TCSVT.2019.2954948
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Existing light field depth map estimation approaches only utilize partial angular views in occlusion areas and local spatial dependencies in the optimization. This paper proposes a novel two-stage light field depth estimation method via graph spectral analysis to exploit the complete correlations and dependencies within angular patches and spatial images. The initial depth map estimation leverages the undirected graph to jointly consider occluded and unoccluded views within each angular patch. The estimated depth minimizes the structural incoherence of its corresponding angular patch with the focused one by evaluating the highest graph frequency component. Subsequently, depth map refinement optimizes the initial depth map with the color consistency and smoothness formulated by weighted adjacency matrix. The structural constraints are efficiently employed using low-pass graph filtering with Chebyshev polynomial approximation. Experimental results demonstrate that the proposed method improves the depth map estimation, especially in the edge regions.
引用
收藏
页码:4269 / 4283
页数:15
相关论文
共 50 条
  • [21] Context-Aware Recommendation System using Graph-based Behaviours Analysis
    Zhang, Lan
    Li, Xiang
    Li, Weihua
    Zhou, Huali
    Bai, Quan
    JOURNAL OF SYSTEMS SCIENCE AND SYSTEMS ENGINEERING, 2021, 30 (04) : 482 - 494
  • [22] Context-Aware Recommendation System using Graph-based Behaviours Analysis
    Lan Zhang
    Xiang Li
    Weihua Li
    Huali Zhou
    Quan Bai
    Journal of Systems Science and Systems Engineering, 2021, 30 : 482 - 494
  • [23] SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation
    Peng, Xidong
    Zhu, Xinge
    Wang, Tai
    Ma, Yuexin
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 225 - 234
  • [24] A Structure-Aware Adversarial Framework with the Keypoint Biorientation Field for Multiperson Pose Estimation
    Meng, Xianjia
    Yang, Yong
    Li, Kang
    Ying, Zuobin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [25] Improved Graph Neural Networks for Spatial Networks Using Structure-Aware Sampling
    Iddianozie, Chidubem
    McArdle, Gavin
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (11)
  • [26] Graph-Based Light Field Super-Resolution
    Rossi, Mattia
    Frossard, Pascal
    2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2017,
  • [27] Structure-aware Depth Super-Resolution using Gaussian Mixture Model
    Kim, Sunok
    Oh, Changjae
    Kim, Youngjung
    Sohn, Kwanghoon
    THREE-DIMENSIONAL IMAGE PROCESSING, MEASUREMENT (3DIPM), AND APPLICATIONS 2015, 2015, 9393
  • [28] Structure-aware dehazing of sewer inspection images based on monocular depth cues
    Xia, Zixia
    Guo, Shuai
    Sun, Di
    Lv, Yaozhi
    Li, Honglie
    Pan, Gang
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2023, 38 (06) : 762 - 778
  • [29] Structure-Aware Pre-Selected Neural Rendering for Light Field Reconstruction
    Chang, Song
    Lin, Youfang
    Zhang, Shuo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1574 - 1587
  • [30] Online Deformable Object Tracking Based on Structure-Aware Hyper-Graph
    Du, Dawei
    Qi, Honggang
    Li, Wenbo
    Wen, Longyin
    Huang, Qingming
    Lyu, Siwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (08) : 3572 - 3584