DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
|
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [41] A NEW PERCEPTUAL QUALITY METRIC FOR COMPRESSED VIDEO
    Bhat, Abharana
    Richardson, Iain
    Kannangara, Sampath
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 933 - 936
  • [42] Perceptual video quality assessment: the journey continues!
    Saha, Avinab
    Pentapati, Sai Karthikey
    Shang, Zaixi
    Pahwa, Ramit
    Chen, Bowen
    Gedik, Hakan Emre
    Mishra, Sandeep
    Bovik, Alan C.
    FRONTIERS IN SIGNAL PROCESSING, 2023, 3
  • [43] QUALITY ASSESSMENT METHODS FOR PERCEPTUAL VIDEO COMPRESSION
    Zhang, Fan
    Bull, David R.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 39 - 43
  • [44] Quality Assessment for a Perceptual Video Encryption System
    Yeung, Siu-Kei Au
    Zhu, Shuyuan
    Zeng, Bing
    2010 IEEE INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND INFORMATION SECURITY (WCNIS), VOL 2, 2010, : 102 - 106
  • [45] A NOVEL PERCEPTUAL QUALITY METRIC FOR VIDEO COMPRESSION
    Bhat, Abharana
    Richardson, Iain
    Kannangara, Sampath
    PCS: 2009 PICTURE CODING SYMPOSIUM, 2009, : 141 - 144
  • [46] Improving perceptual quality for Internet video streaming
    Chin, SK
    Braun, R
    CONFERENCE RECORD OF THE THIRTY-FIFTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, VOLS 1 AND 2, 2001, : 523 - 528
  • [47] Objectification of perceptual image quality for mobile video
    Lee, Seon-Oh
    Sim, Dong-Gyu
    OPTICAL ENGINEERING, 2011, 50 (06)
  • [48] TEMPORAL POOLING OF VIDEO QUALITY ESTIMATES USING PERCEPTUAL MOTION MODELS
    Lee, Kwanghyun
    Park, Jincheol
    Lee, Sanghoon
    Bovik, Alan C.
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2493 - 2496
  • [49] Prediction of Perceptual Quality for Mobile Video Using Fuzzy Inference Systems
    Alreshoodi, Mohammed
    Danish, Emad
    Woods, John
    Fernando, Anil
    De Alwis, Chamitha
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2015, 61 (04) : 546 - 554
  • [50] Perceptual video quality assessment in H.264 video coding standard using objective modeling
    Karthikeyan, Ramasamy
    Sainarayanan, Gopalakrishnan
    Deepa, Subramaniam Nachimuthu
    SPRINGERPLUS, 2014, 3 : 1 - 6