MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos

被引:24
|
作者
Zhang, Zicheng [1 ]
Wu, Wei [2 ]
Sun, Wei [1 ]
Tu, Danyang [1 ]
Lu, Wei [1 ]
Min, Xiongkuo [1 ]
Chen, Ying [2 ]
Zhai, Guangtao [1 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Image Commun & Network Engn, Shanghai, Peoples R China
[2] Alibaba Grp, Hangzhou, Peoples R China
[3] Shanghai Jiao Tong Univ, AI Inst, MoE Key Lab Artificial Intelligence, Shanghai, Peoples R China
基金
国家重点研发计划;
关键词
COMPRESSION; PREDICTION;
D O I
10.1109/CVPR52729.2023.00174
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User-generated content (UGC) live videos are often bothered by various distortions during capture procedures and thus exhibit diverse visual qualities. Such source videos are further compressed and transcoded by media server providers before being distributed to end-users. Because of the flourishing of UGC live videos, effective video quality assessment (VQA) tools are needed to monitor and perceptually optimize live streaming videos in the distributing process. In this paper, we address UGC Live VQA problems by constructing a first-of-a-kind subjective UGC Live VQA database and developing an effective evaluation tool. Concretely, 418 source UGC videos are collected in real live streaming scenarios and 3,762 compressed ones at different bit rates are generated for the subsequent subjective VQA experiments. Based on the built database, we develop a Multi-Dimensional VQA (MD-VQA) evaluator to measure the visual quality of UGC live videos from semantic, distortion, and motion aspects respectively. Extensive experimental results show that MD-VQA achieves state-of-the-art performance on both our UGC Live VQA database and existing compressed UGC VQA databases.
引用
收藏
页码:1746 / 1755
页数:10
相关论文
共 50 条
  • [1] Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancement
    Dong, Yunlong
    Liu, Xiaohong
    Gao, Yixuan
    Zhou, Xunchu
    Tan, Tao
    Zhai, Guangtao
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1088 - 1097
  • [2] Multi-Dimensional Feature Fusion Network for No-Reference Quality Assessment of In-the-Wild Videos
    Jiang, Jiu
    Wang, Xianpei
    Li, Bowen
    Tian, Meng
    Yao, Hongtai
    SENSORS, 2021, 21 (16)
  • [3] Rich features for perceptual quality assessment of UGC videos
    Wang, Yilin
    Ke, Junjie
    Talebi, Hossein
    Yim, Joong Gon
    Birkbeck, Neil
    Adsumilli, Balu
    Milanfar, Peyman
    Yang, Feng
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13430 - 13439
  • [4] Quality Assessment of UGC Videos Based on Decomposition and Recomposition
    Liu, Yongxu
    Wu, Jinjian
    Li, Leida
    Dong, Weisheng
    Shi, Guangming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (03) : 1043 - 1054
  • [5] UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
    Tu, Zhengzhong
    Wang, Yilin
    Birkbeck, Neil
    Adsumilli, Balu
    Bovik, Alan C.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4449 - 4464
  • [6] MT-VQA: A Multi-task Approach for Quality Assessment of Short-form Videos
    Wen, Shijie
    Qiao, Minglang
    Jiang, Lai
    Xu, Mai
    Deng, Xin
    Li, Shengxi
    PROCEEDINGS OF THE 3RD WORKSHOP ON QUALITY OF EXPERIENCE IN VISUAL MULTIMEDIA APPLICATIONS, QOEVMA 2024, 2024, : 30 - 38
  • [7] Web Article Quality Assessment in Multi-dimensional Space
    Han, Jingyu
    Fu, Xiong
    Chen, Kejia
    Wang, Chuandong
    WEB-AGE INFORMATION MANAGEMENT, 2011, 6897 : 214 - 225
  • [8] A NO REFERENCE DEEP LEARNING BASED MODEL FOR QUALITY ASSESSMENT OF UGC VIDEOS
    Lamichhane, Kamal
    Mazumdar, Pramit
    Battisti, Federica
    Carli, Marco
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [9] Design of a Multi-Dimensional Model for UGC-Based Emotion Analysis
    Wang, Yen-Jou
    Yen, Neil
    Hung, Jason C.
    2019 6TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2019), 2019, : 1383 - 1387
  • [10] A Deep Learning based No-reference Quality Assessment Model for UGC Videos
    Sun, Wei
    Min, Xiongkuo
    Lu, Wei
    Zhai, Guangtao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022,