A Light-Field Video Dataset of Scenes with Moving Objects Captured with a Plenoptic Video Camera

被引:0
|
作者
Javidi, Kamran [1 ]
Martini, Maria G. [1 ]
机构
[1] Kingston Univ, Fac Engn Comp & Environm, Sch Comp Sci & Math, Dept Networks & Digital Media,Wireless & Multimedi, Penrhyn Rd Campus, Kingston Upon Thames KT1 2EE, England
关键词
light field; dataset; content characterisation; objective quality assessment;
D O I
10.3390/electronics13112223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Light-field video provides a detailed representation of scenes captured from different perspectives. This results in a visualisation modality that enhances the immersion and engagement of the viewers with the depicted environment. In order to perform research on compression, transmission and signal processing of light field data, datasets with light-field contents of different categories and acquired with different modalities are required. In particular, the development of machine learning models for quality assessment and for light-field processing, including the generation of new views, require large amounts of data. Most existing datasets consist of static scenes and, in many cases, synthetic contents. This paper presents a novel light-field plenoptic video dataset, KULFR8, involving six real-world scenes with moving objects and 336 distorted light-field videos derived from the original contents; in total, the original scenes in the dataset contain 1800 distinctive frames, with angular resolution of 5x5 with and total spatial resolution of 9600x5400 pixels (considering all the views); overall, the dataset consists of 45,000 different views with spatial resolution of 1920x1080 pixels. We analyse the content characteristics based on the dimensions of the captured objects and via the acquired videos using the central views extracted from each quilted frame. Additionally, we encode and decode the contents using various video encoders across different bitrate ranges. For quality assessments, we consider all the views, utilising frames measuring 9600x5400 pixels, and employ two objective quality metrics: PSNR and SSIM.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Moving Objects Detection in Video Sequences Captured by a PTZ Camera
    Lin, Li
    Wang, Bin
    Wu, Fen
    Cao, Fengyin
    IMAGE AND GRAPHICS (ICIG 2017), PT III, 2017, 10668 : 287 - 298
  • [2] Dataset and Pipeline for Multi-View Light-Field Video
    Sabater, N.
    Boisson, G.
    Vandame, B.
    Kerbiriou, P.
    Babon, F.
    Hog, M.
    Gendrot, R.
    Langlois, T.
    Bureller, O.
    Schubert, A.
    Allie, V.
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1743 - 1753
  • [3] From the Calibration of a Light-Field Camera to Direct Plenoptic Odometry
    Zeller, Niclas
    Quint, Franz
    Stilla, Uwe
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (07) : 1004 - 1019
  • [4] Moving object detection and tracking from video captured by moving camera
    Hu, Wu-Chih
    Chen, Chao-Ho
    Chen, Tsong-Yi
    Huang, Deng-Yuan
    Wu, Zong-Che
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 30 : 164 - 180
  • [5] Adapted Windows Detection of Moving Objects in Video Scenes
    Dibos, Francoise
    Koepfler, Georges
    Pelletier, Sylvain
    SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01): : 1 - 19
  • [6] The Light Field Video Camera
    Wilburn, B
    Smulski, M
    Lee, K
    Horowitz, MA
    MEDIA PROCESSORS 2002, 2002, 4674 : 29 - 36
  • [7] The perceived quality of light-field video services
    Kara, Peter A.
    Tamboli, Roopak R.
    Cserkaszky, Aron
    Martini, Maria G.
    Barsi, Attila
    Bokor, Laszlo
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLI, 2018, 10752
  • [8] ALGORITHM FOR DETECTION OF MOVING OBJECTS OBSERVED BY A VIDEO CAMERA
    Zalesky, Boris A.
    DOKLADY NATSIONALNOI AKADEMII NAUK BELARUSI, 2023, 67 (01): : 20 - 26
  • [9] Light-Field Microscopy with a Consumer Light-Field Camera
    Mignard-Debise, Lois
    Ihrke, Ivo
    2015 INTERNATIONAL CONFERENCE ON 3D VISION, 2015, : 335 - 343
  • [10] New trends on moving object detection in video images captured by a moving camera: A survey
    Yazdi, Mehran
    Bouwmans, Thierry
    COMPUTER SCIENCE REVIEW, 2018, 28 : 157 - 177