Spatial-angular features based no-reference light field quality assessment

被引:0
|
作者
Yu, Zerui [1 ,2 ]
Li, Fei [2 ,3 ]
Zhou, Zhiheng [1 ]
Tao, Xiyuan [4 ]
机构
[1] South China Univ Technol, Sch Future Technol, Guangzhou 510000, Peoples R China
[2] PengCheng Lab, Shenzhen 518055, Peoples R China
[3] Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
[4] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510640, Peoples R China
关键词
Light field image; No-reference image quality assessment; Refocused images; Joint statistics; Variance-enhanced local binary patterns; JOINT STATISTICS; IMAGES; CAMERA; DEPTH; PHASE;
D O I
10.1016/j.eswa.2024.126061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light Field (LF) is capable of capturing light intensity as well as information about the direction and position of the light, resulting in an immersive visual experience. Visual quality can be greatly influenced by the distortion due to light field image (LFI) processing, such as compression or reconstruction. Therefore, the development of a perceptual quality measure for LFIs is imperative. Refocused images (RIs), as an important form of visualization applications of LF, capture the spatial quality, semantic and depth information, while epipolar plane images (EPIs) reflect the angular consistency. Based on these two kinds of views, a novel spatial- angular features based no-reference light field image quality assessment (NR-LFIQA) metric is presented in this work. Existing methods that use RIs to extract spatial features from LFIs typically follow approaches from the IQA field, neglecting the unique properties of RIs as multi-distorted images. Therefore, this paper proposes to analyze RIs by considering both edge and texture features. For angular features, this paper analyzes the shortcomings of LBP, and the variance-enhanced LBP (VELBP) is designed to improve the adaptability of LBP to light fields. Experimental results show that the proposed model outperforms the existing LFIQA models on four publicly available datasets. The source code for the paper will be published after it is organized.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] No-Reference Image Quality Assessment with Global Statistical Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2021, 7 (02)
  • [32] No-Reference Image Quality Assessment by Hallucinating Pristine Features
    Chen, Baoliang
    Zhu, Lingyu
    Kong, Chenqi
    Zhu, Hanwei
    Wang, Shiqi
    Li, Zhu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6139 - 6151
  • [33] Hybrid NSS features for no-reference image quality assessment
    Qin, Min
    Lv, Xiaoxin
    Chen, Xiaohui
    Wang, Weidong
    IET IMAGE PROCESSING, 2017, 11 (06) : 443 - 449
  • [34] Full Reference Light Field Image Quality Evaluation Based on Angular-Spatial Characteristic
    Meng, Chunli
    An, Ping
    Huang, Xinpeng
    Yang, Chao
    Liu, Deyang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 525 - 529
  • [35] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Wang, Sizhe
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Cong, Ruixuan
    Ke, Wei
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20327 - 20345
  • [36] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Sizhe Wang
    Hao Sheng
    Da Yang
    Zhenglong Cui
    Ruixuan Cong
    Wei Ke
    Applied Intelligence, 2023, 53 : 20327 - 20345
  • [37] A no-reference assessment model for quality of networked video based on features of packets loss
    Liu, Hechao
    Yang, Fuzheng
    Chang, Yilin
    Yuan, Hui
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2012, 46 (02): : 130 - 134
  • [38] No-reference Quality Assessment of Panoramic Video based on Spherical-domain Features
    Zhang, Yingxue
    Liu, Zizheng
    Chen, Zhenzhong
    Xu, Xiaozhong
    Liu, Shan
    2021 PICTURE CODING SYMPOSIUM (PCS), 2021, : 271 - 275
  • [39] No-Reference Video Quality Assessment Based on Benford's Law and Perceptual Features
    Varga, Domonkos
    ELECTRONICS, 2021, 10 (22)
  • [40] No-Reference Quality Assessment of Authentically Distorted Images Based on Local and Global Features
    Varga, Domonkos
    JOURNAL OF IMAGING, 2022, 8 (06)