Spatial-angular features based no-reference light field quality assessment

被引:0
|
作者
Yu, Zerui [1 ,2 ]
Li, Fei [2 ,3 ]
Zhou, Zhiheng [1 ]
Tao, Xiyuan [4 ]
机构
[1] South China Univ Technol, Sch Future Technol, Guangzhou 510000, Peoples R China
[2] PengCheng Lab, Shenzhen 518055, Peoples R China
[3] Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
[4] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510640, Peoples R China
关键词
Light field image; No-reference image quality assessment; Refocused images; Joint statistics; Variance-enhanced local binary patterns; JOINT STATISTICS; IMAGES; CAMERA; DEPTH; PHASE;
D O I
10.1016/j.eswa.2024.126061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light Field (LF) is capable of capturing light intensity as well as information about the direction and position of the light, resulting in an immersive visual experience. Visual quality can be greatly influenced by the distortion due to light field image (LFI) processing, such as compression or reconstruction. Therefore, the development of a perceptual quality measure for LFIs is imperative. Refocused images (RIs), as an important form of visualization applications of LF, capture the spatial quality, semantic and depth information, while epipolar plane images (EPIs) reflect the angular consistency. Based on these two kinds of views, a novel spatial- angular features based no-reference light field image quality assessment (NR-LFIQA) metric is presented in this work. Existing methods that use RIs to extract spatial features from LFIs typically follow approaches from the IQA field, neglecting the unique properties of RIs as multi-distorted images. Therefore, this paper proposes to analyze RIs by considering both edge and texture features. For angular features, this paper analyzes the shortcomings of LBP, and the variance-enhanced LBP (VELBP) is designed to improve the adaptability of LBP to light fields. Experimental results show that the proposed model outperforms the existing LFIQA models on four publicly available datasets. The source code for the paper will be published after it is organized.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] No-Reference Image Quality Assessment in Spatial Domain
    Sun, Tao
    Zhu, Xingjie
    Pan, Jeng-Shyang
    Wen, Jiajun
    Meng, Fanqiang
    GENETIC AND EVOLUTIONARY COMPUTING, 2015, 329 : 381 - 388
  • [22] SADN: LEARNED LIGHT FIELD IMAGE COMPRESSION WITH SPATIAL-ANGULAR DECORRELATION
    Tong, Kedeng
    Jin, Xin
    Wang, Chen
    Jiang, Fan
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1870 - 1874
  • [23] No-Reference Image Quality Assessment Based on the Fusion of Statistical and Perceptual Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2020, 6 (08)
  • [24] No-Reference Video Quality Assessment Based on the Temporal Pooling of Deep Features
    Domonkos Varga
    Neural Processing Letters, 2019, 50 : 2595 - 2608
  • [25] No-Reference Video Quality Assessment Based on the Temporal Pooling of Deep Features
    Varga, Domonkos
    NEURAL PROCESSING LETTERS, 2019, 50 (03) : 2595 - 2608
  • [26] A Denoising Method for Light Field Imaging Sensor Based on Spatial-Angular Collaborative Encoding Network
    Chen, Yeyao
    Jiang, Gangyi
    Yu, Mei
    Jiang, Zhidi
    Ho, Yo-Sung
    IEEE SENSORS JOURNAL, 2021, 21 (16) : 17973 - 17983
  • [27] Evaluation of illumination quality based on spatial-angular luminance distribution
    Budak, Vladimir P. (budakvp@gmail.com), 1600, LLC Editorial of Journal Light Technik (25):
  • [28] EVALUATION OF ILLUMINATION QUALITY BASED ON SPATIAL-ANGULAR LUMINANCE DISTRIBUTION
    Budak, Vladimir P.
    Zheltov, Victor S.
    Meshkova, Tatiyana V.
    Notfullin, Renat Sh.
    LIGHT & ENGINEERING, 2017, 25 (04): : 24 - 31
  • [29] No-Reference Image Quality Assessment and Application Based on Spatial Domain Coding
    Chen Yong
    Fang Hao
    Liu Huanlin
    IEEE ACCESS, 2018, 6 : 60456 - 60466
  • [30] LFACon: Introducing Anglewise Attention to No-Reference Quality Assessment in Light Field Space
    Qu, Qiang
    Chen, Xiaoming
    Chung, Yuk Ying
    Cai, Weidong
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (05) : 2239 - 2248