A Light-Field Video Dataset of Scenes with Moving Objects Captured with a Plenoptic Video Camera

被引:0
|
作者
Javidi, Kamran [1 ]
Martini, Maria G. [1 ]
机构
[1] Kingston Univ, Fac Engn Comp & Environm, Sch Comp Sci & Math, Dept Networks & Digital Media,Wireless & Multimedi, Penrhyn Rd Campus, Kingston Upon Thames KT1 2EE, England
关键词
light field; dataset; content characterisation; objective quality assessment;
D O I
10.3390/electronics13112223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Light-field video provides a detailed representation of scenes captured from different perspectives. This results in a visualisation modality that enhances the immersion and engagement of the viewers with the depicted environment. In order to perform research on compression, transmission and signal processing of light field data, datasets with light-field contents of different categories and acquired with different modalities are required. In particular, the development of machine learning models for quality assessment and for light-field processing, including the generation of new views, require large amounts of data. Most existing datasets consist of static scenes and, in many cases, synthetic contents. This paper presents a novel light-field plenoptic video dataset, KULFR8, involving six real-world scenes with moving objects and 336 distorted light-field videos derived from the original contents; in total, the original scenes in the dataset contain 1800 distinctive frames, with angular resolution of 5x5 with and total spatial resolution of 9600x5400 pixels (considering all the views); overall, the dataset consists of 45,000 different views with spatial resolution of 1920x1080 pixels. We analyse the content characteristics based on the dimensions of the captured objects and via the acquired videos using the central views extracted from each quilted frame. Additionally, we encode and decode the contents using various video encoders across different bitrate ranges. For quality assessments, we consider all the views, utilising frames measuring 9600x5400 pixels, and employ two objective quality metrics: PSNR and SSIM.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Light-field depth estimation considering plenoptic imaging distortion
    Cai, Zewei
    Liu, Xiaoli
    Pedrini, Giancarlo
    Osten, Wolfgang
    Peng, Xiang
    OPTICS EXPRESS, 2020, 28 (03): : 4156 - 4168
  • [32] Intelligent Technique for Moving Object Detection from Problematic Video Captured through Camera Sensor
    Mishra, Sneha
    Yadav, Dileep Kumar
    RECENT ADVANCES IN ELECTRICAL & ELECTRONIC ENGINEERING, 2024, 17 (02) : 107 - 115
  • [33] Scenes-Objects-Actions: A Multi-task, Multi-label Video Dataset
    Ray, Jamie
    Wang, Heng
    Tran, Du
    Wang, Yufei
    Feiszli, Matt
    Torresani, Lorenzo
    Paluri, Manohar
    COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 660 - 676
  • [34] Robust Motion Objects Detection in Moving Camera Scenes
    Zhong, Yangjun
    Zhang, Shuiping
    SMART MATERIALS AND INTELLIGENT SYSTEMS, PTS 1 AND 2, 2011, 143-144 : 782 - +
  • [35] Video Retrieval for Everyday Scenes With Common Objects
    Zachariah, Arun
    Rao, Praveen
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 565 - 570
  • [36] Video retrieval based on video motion tracks of moving objects
    Chen, PY
    Chen, ALP
    STORAGE AND RETRIEVAL METHODS AND APPLICATIONS FOR MULTIMEDIA 2004, 2004, 5307 : 550 - 558
  • [37] A GROUND TRUTH ANNOTATED VIDEO DATASET FOR MOVING OBJECT DETECTION IN DEGRADED ATMOSPHERIC OUTDOOR SCENES
    Roy, Sourav Dey
    Bhowmik, Mrinal Kanti
    Oakley, John
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1318 - 1322
  • [38] Video compression quality metric for moving scenes
    Grim, M
    Royce, G
    Szu, H
    Hsu, C
    WAVELET APPLICATIONS V, 1998, 3391 : 233 - 244
  • [39] Moving objects extraction in diving video
    Li, Y
    Liao, QM
    IMAGE AND VIDEO COMMUNICATIONS AND PROCESSING 2003, PTS 1 AND 2, 2003, 5022 : 1102 - 1110
  • [40] Mosaics of video sequences with moving objects
    Hsu, CT
    Tsan, YC
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2001, : 387 - 390