Spatial-angular features based no-reference light field quality assessment

被引:0
|
作者
Yu, Zerui [1 ,2 ]
Li, Fei [2 ,3 ]
Zhou, Zhiheng [1 ]
Tao, Xiyuan [4 ]
机构
[1] South China Univ Technol, Sch Future Technol, Guangzhou 510000, Peoples R China
[2] PengCheng Lab, Shenzhen 518055, Peoples R China
[3] Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
[4] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510640, Peoples R China
关键词
Light field image; No-reference image quality assessment; Refocused images; Joint statistics; Variance-enhanced local binary patterns; JOINT STATISTICS; IMAGES; CAMERA; DEPTH; PHASE;
D O I
10.1016/j.eswa.2024.126061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light Field (LF) is capable of capturing light intensity as well as information about the direction and position of the light, resulting in an immersive visual experience. Visual quality can be greatly influenced by the distortion due to light field image (LFI) processing, such as compression or reconstruction. Therefore, the development of a perceptual quality measure for LFIs is imperative. Refocused images (RIs), as an important form of visualization applications of LF, capture the spatial quality, semantic and depth information, while epipolar plane images (EPIs) reflect the angular consistency. Based on these two kinds of views, a novel spatial- angular features based no-reference light field image quality assessment (NR-LFIQA) metric is presented in this work. Existing methods that use RIs to extract spatial features from LFIs typically follow approaches from the IQA field, neglecting the unique properties of RIs as multi-distorted images. Therefore, this paper proposes to analyze RIs by considering both edge and texture features. For angular features, this paper analyzes the shortcomings of LBP, and the variance-enhanced LBP (VELBP) is designed to improve the adaptability of LBP to light fields. Experimental results show that the proposed model outperforms the existing LFIQA models on four publicly available datasets. The source code for the paper will be published after it is organized.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement
    Shi, Likun
    Zhou, Wei
    Chen, Zhibo
    Zhang, Jinglin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (11) : 4114 - 4128
  • [2] No-reference light field image quality assessment based on depth, structural and angular information
    Xiang, Jianjun
    Jiang, Gangyi
    Yu, Mei
    Bai, Yongqiang
    Zhu, Zhongjie
    SIGNAL PROCESSING, 2021, 184
  • [3] Spatial-angular Quality-aware Representation Learning for Blind Light Field Image Quality Assessment
    Xiang, Jianjun
    Dang, Yuanjie
    Chen, Peng
    Liang, Ronghua
    Huan, Ruohong
    Zhang, Zhengyu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1077 - 1087
  • [4] Light field image encryption based on spatial-angular characteristic
    Wei, Kangkang
    Wen, Wenying
    Fang, Yuming
    SIGNAL PROCESSING, 2021, 185
  • [5] Light Field alpha Matting Based on Spatial-Angular Consistency
    Liu Tianyi
    Qiu Jun
    He Di
    Liu Chang
    ACTA OPTICA SINICA, 2022, 42 (16)
  • [6] Graph-based No-reference Video Quality Assessment Using Spatial Features
    Suresh, N.
    Channappayya, Sumohana S.
    2024 INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS, SPCOM 2024, 2024,
  • [7] Graph-based No-Reference Video Quality Assessment Using Spatial Features
    Department of Artificial Intelligence
    不详
    Int. Conf. Signal Process. Commun., SPCOM, 2024,
  • [8] Light field reconstruction based on spatial-angular decouple and fuse network
    Zhang Hong-ji
    Deng Hui-ping
    Xiang Sen
    Wu Jin
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2022, 37 (10) : 1345 - 1354
  • [9] Spatial-Angular Attention Network for Light Field Reconstruction
    Wu, Gaochang
    Wang, Yingqian
    Liu, Yebin
    Fang, Lu
    Chai, Tianyou
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8999 - 9013
  • [10] Learning a Compact Spatial-Angular Representation for Light Field
    Sun, Yangfan
    Li, Li
    Li, Zhu
    Wang, Shizheng
    Liu, Shan
    Li, Ge
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7262 - 7273