DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
|
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Perceptual video quality assessment: a survey
    Min, Xiongkuo
    Duan, Huiyu
    Sun, Wei
    Zhu, Yucheng
    Zhai, Guangtao
    SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (11)
  • [22] Colour perceptual video quality metric
    Ong, E
    Lin, WS
    Lu, ZK
    Yao, SS
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 2957 - 2960
  • [23] Quality estimation of monochrome video using quality of each frame
    Horita, Y
    Inazumi, Y
    Murai, T
    ELECTRONICS AND COMMUNICATIONS IN JAPAN PART I-COMMUNICATIONS, 2000, 83 (11): : 55 - 65
  • [24] Deep-Learned Perceptual Quality Control for Intelligent Video Communication
    Sun, Xuebin
    Wang, Miaohui
    Lin, Rongfu
    Sun, Yuxiang
    Cheng, Shing Shin
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2022, 68 (04) : 354 - 365
  • [25] Perceptual video quality evaluation using fuzzy inference system
    Yao, SS
    Lin, WS
    Lu, ZK
    Ong, EP
    Yang, XK
    2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 3, PROCEEDINGS, 2004, : 897 - 900
  • [26] Perceptual quality assessment of video using machine learning algorithm
    Mustafa, Safi
    Hameed, Abdul
    SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (08) : 1495 - 1502
  • [27] Perceptual quality assessment of video using machine learning algorithm
    Safi Mustafa
    Abdul Hameed
    Signal, Image and Video Processing, 2019, 13 : 1495 - 1502
  • [28] Text quality estimation in video
    Li, HP
    Doermann, D
    DOCUMENT RECOGNITION AND RETRIEVAL IX, 2002, 4670 : 232 - 243
  • [29] Investigation of Video Quality Dimensions for Different Type of Video Content
    Schiffner, Falk
    Bondarenko, Vladimir
    Moeller, Sebastian
    2018 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2018), 2018, : 122 - 126
  • [30] HDR video quality assessment: Perceptual evaluation of compressed HDR video
    Pan, Xiaofei
    Zhang, Jiaqi
    Wang, Shanshe
    Wang, Shiqi
    Zhou, Yun
    Ding, Wenhua
    Yang, Yahui
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 57 : 76 - 83