DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
|
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Quality Estimation Models for Gaming Video Streaming Services Using Perceptual Video Quality Dimensions
    Zadtootaghaj, Saman
    Schmidt, Steven
    Sabet, Saeed Shafiee
    Moeller, Sebastian
    Griwodz, Carsten
    MMSYS'20: PROCEEDINGS OF THE 2020 MULTIMEDIA SYSTEMS CONFERENCE, 2020, : 213 - 224
  • [2] A parametric model for perceptual video quality estimation
    Jose Joskowicz
    J. Carlos Lopez Ardao
    Telecommunication Systems, 2012, 49 : 49 - 62
  • [3] A parametric model for perceptual video quality estimation
    Joskowicz, Jose
    Lopez Ardao, J. Carlos
    TELECOMMUNICATION SYSTEMS, 2012, 49 (01) : 49 - 62
  • [4] Direct Scaling & Quality Prediction for perceptual Video Quality Dimensions
    Schiffner, Falk
    Moeller, Sebastian
    2018 TENTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2018, : 51 - 53
  • [5] Towards a General Parametric Model for Perceptual Video Quality Estimation
    Joskowicz, Jose
    Sotelo, Rafael
    Lopez Ardao, J. Carlos
    IEEE TRANSACTIONS ON BROADCASTING, 2013, 59 (04) : 569 - 579
  • [6] Improving perceptual quality in video watermarking using motion estimation
    Noorkami, Maneli
    Mersereau, Russell M.
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 1389 - +
  • [7] Perceptual Quality Driven Adaptive Video Coding Using JND Estimation
    Takeuchi, Masaru
    Saika, Shintaro
    Sakamoto, Yusuke
    Nagashima, Tatsuya
    Cheng, Zhengxue
    Kanai, Kenji
    Katto, Jiro
    Wei, Kaijin
    Ju Zengwei
    Xu Wei
    2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 179 - 183
  • [8] A Mathematical Model for Evaluating the Perceptual Quality of Video
    Joskowicz, Jose
    Lopez-Ardao, Jose-Carlos
    Gonzalez Ortega, Miguel A.
    Lopez Garcia, Candido
    FUTURE MULTIMEDIA NETWORKING, PROCEEDINGS, 2009, 5630 : 164 - 175
  • [9] Perceptual Video Quality Estimation By Regression With Myopic Experts
    Giotsas, Vasileios
    Deligiannis, Nikos
    Fisher, Pam
    Andreopoulos, Yiannis
    2015 SEVENTH INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2015,
  • [10] Encoding of video in layers based on perceptual quality of video
    Thakur, Aruna
    Motyckova-Carr, Lenka
    Advances in Automation, Multimedia and Video Systems, and Modern Computer Science, 2001, : 162 - 167