No Reference Quality Assessment of Stereo Video Based on Saliency and Sparsity

被引:40
|
作者
Yang, Jiachen [1 ]
Ji, Chunqi [1 ]
Jiang, Bin [1 ]
Lu, Wen [2 ]
Meng, Qinggang [3 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 30072, Peoples R China
[2] Xidian Univ, Sch Elect Engn, Xian 710071, Shaanxi, Peoples R China
[3] Loughborough Univ, Dept Comp Sci, Loughborough LE11 3TU, Leics, England
基金
中国国家自然科学基金;
关键词
Stereoscopic video quality assessment; saliency; sparse representation; stacked auto-encoder (SAE); sparsity; VISUAL-ATTENTION; INDUCED INDEX; IMAGES; REPRESENTATION; PERCEPTION;
D O I
10.1109/TBC.2018.2789583
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the popularity of video technology, stereoscopic video quality assessment (SVQA) has become increasingly important. Existing SVQA methods cannot achieve good performance because the videos' information is not fully utilized. In this paper, we consider various information in the videos together, construct a simple model to combine and analyze the diverse features, which is based on saliency and sparsity. First, we utilize the 3-D saliency map of sum map, which remains the basic information of stereoscopic video, as a valid tool to evaluate the videos' quality. Second, we use the sparse representation to decompose the sum map of 3-D saliency into coefficients, then calculate the features based on sparse coefficients to obtain the effective expression of videos' message. Next, in order to reduce the relevance between the features, we put them into stacked auto-encoder, mapping vectors to higher dimensional space, and adding the sparse restraint, then input them into support vector machine subsequently, and finally, get the quality assessment scores. Within that process, we take the advantage of saliency and sparsity to extract and simplify features. Through the later experiment, we can see the proposed method is fitting well with the subjective scores.
引用
收藏
页码:341 / 353
页数:13
相关论文
共 50 条
  • [1] Quality Assessment of Stereo Images using Reduced Reference Based on Saliency Region
    Boaz, Too Kipyego
    Prabhakar, C. J.
    2014 INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING AND INFORMATICS (IC3I), 2014, : 503 - 508
  • [2] An image quality assessment algorithm based on saliency and sparsity
    Banitalebi-Dehkordi, Mehdi
    Khademi, Morteza
    Ebrahimi-Moghadam, Abbas
    Hadizadeh, Hadi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (09) : 11507 - 11526
  • [3] An image quality assessment algorithm based on saliency and sparsity
    Mehdi Banitalebi-Dehkordi
    Morteza Khademi
    Abbas Ebrahimi-Moghadam
    Hadi Hadizadeh
    Multimedia Tools and Applications, 2019, 78 : 11507 - 11526
  • [4] Objective No-reference Stereo Video Quality Assessment Research
    Li, Yan
    Yang, Yu
    PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA TECHNOLOGY (ICMT-13), 2013, 84 : 1228 - 1233
  • [5] Binocular perception based reduced-reference stereo video quality assessment method
    Yu, Mei
    Zheng, Kaihui
    Jiang, Gangyi
    Shao, Feng
    Peng, Zongju
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 38 : 246 - 255
  • [6] No reference stereo video quality assessment based on motion feature in tensor decomposition domain
    Jiang, Gangyi
    Liu, Shanshan
    Yu, Mei
    Shao, Feng
    Peng, Zongju
    Chen, Fen
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 50 : 247 - 262
  • [7] No-Reference Video quality assessment of H.264 video streams based on semantic saliency maps
    Boujut, H.
    Benois-Pineau, J.
    Ahmed, T.
    Hadar, O.
    Bonnet, P.
    IMAGE QUALITY AND SYSTEM PERFORMANCE IX, 2012, 8293
  • [8] Saliency and Texture Information Based Full-Reference Quality Metrics for Video QoE Assessment
    Luo, Qian
    Geng, Yang
    Liu, Jichun
    Li, Wenjing
    2014 IEEE NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (NOMS), 2014,
  • [9] A METRIC FOR NO-REFERENCE VIDEO QUALITY ASSESSMENT FOR HD TV DELIVERY BASED ON SALIENCY MAPS
    Boujut, H.
    Benois-Pineau, J.
    Ahmed, T.
    Hadar, O.
    Bonnet, P.
    2011 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2011,
  • [10] Full-Reference SSIM Metric for Video Quality Assessment with Saliency-Based Features
    Romani, Eduardo
    da Silva, Wyllian Bezerra
    Ono Fonseca, Keiko Veronica
    Culibrk, Dubravko
    Prado Pohl, Alexandre de Almeida
    NEW TRENDS IN IMAGE ANALYSIS AND PROCESSING - ICIAP 2015 WORKSHOPS, 2015, 9281 : 547 - 554