Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [31] Light Field Super-Resolution with Zero-Shot Learning
    Cheng, Zhen
    Xiong, Zhiwei
    Chen, Chang
    Liu, Dong
    Zha, Zheng-Jun
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10005 - 10014
  • [32] Depth-guided learning light field angular super-resolution with edge-aware inpainting
    Liu, Xia
    Wang, Minghui
    Wang, Anzhi
    Hua, Xiyao
    Liu, Shanshan
    VISUAL COMPUTER, 2022, 38 (08): : 2839 - 2851
  • [33] Super-Resolution Reconstruction of Light Field Images via Sparse Representation
    Ge Peng
    You Yaotang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (02)
  • [34] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Sizhe Wang
    Hao Sheng
    Da Yang
    Zhenglong Cui
    Ruixuan Cong
    Wei Ke
    Applied Intelligence, 2023, 53 : 20327 - 20345
  • [35] MFSRNet: spatial-angular correlation retaining for light field super-resolution
    Wang, Sizhe
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Cong, Ruixuan
    Ke, Wei
    APPLIED INTELLIGENCE, 2023, 53 (17) : 20327 - 20345
  • [36] Joint Light Field Spatial and Angular Super-Resolution From a Single Image
    Ivan, Andre
    Williem
    Park, In Kyu
    IEEE ACCESS, 2020, 8 : 112562 - 112573
  • [37] A survey for light field super-resolution
    Zhao, Mingyuan
    Sheng, Hao
    Yang, Da
    Wang, Sizhe
    Cong, Ruixuan
    Cui, Zhenglong
    Chen, Rongshan
    Wang, Tun
    Wang, Shuai
    Huang, Yang
    Shen, Jiahao
    HIGH-CONFIDENCE COMPUTING, 2024, 4 (01):
  • [38] Light Field Super-Resolution: A Benchmark
    Cheng, Zhen
    Xiong, Zhiwei
    Chen, Chang
    Liu, Dong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1804 - 1813
  • [39] A DEM Super-Resolution Reconstruction Network Combining Internal and External Learning
    Lin, Xu
    Zhang, Qingqing
    Wang, Hongyue
    Yao, Chaolong
    Chen, Changxin
    Cheng, Lin
    Li, Zhaoxiong
    REMOTE SENSING, 2022, 14 (09)
  • [40] Light field image super-resolution using a Content-Aware Spatial-Angular Interaction network
    Shi, Wuzhen
    Su, Jiajun
    Wen, Yang
    Liu, Yutao
    DISPLAYS, 2024, 84