Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [41] Light-field spatial super-resolution via enhanced spatial-angular separable convolutional network
    Hua, Xiyao
    Wang, Minghui
    Su, Boni
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [42] View Synthesis Method with Partitioned Image for Angular Super-Resolution
    Kim, Dong-Myung
    Kang, Hyun-Soo
    Suh, Jae-Won
    2020 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2020,
  • [43] Light field super-resolution using complementary-view feature attention
    Zhang, Wei
    Ke, Wei
    Yang, Da
    Sheng, Hao
    Xiong, Zhang
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (04) : 843 - 858
  • [44] Direct Inter-Intra View Association for Light Field Super-Resolution
    Yang, Da
    Sheng, Hao
    Wang, Shuai
    Chen, Rongshan
    Xiong, Zhang
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT V, 2024, 14451 : 265 - 278
  • [45] Hierarchical feature fusion network for light field spatial super-resolution
    Hua, Xiyao
    Wang, Minghui
    Su, Boni
    Liu, Xia
    VISUAL COMPUTER, 2023, 39 (01): : 267 - 279
  • [46] Deep Neural Network for Joint Light Field Deblurring and Super-Resolution
    Lumentut, Jonathan Samuel
    Park, In Kyu
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2020, 2020, 11515
  • [47] Hierarchical feature fusion network for light field spatial super-resolution
    Xiyao Hua
    Minghui Wang
    Boni Su
    Xia Liu
    The Visual Computer, 2023, 39 : 267 - 279
  • [48] Multiframe super resolution reconstruction method based on light field angular images
    Zhou, Shubo
    Yuan, Yan
    Su, Lijuan
    Ding, Xiaomin
    Wang, Jichao
    OPTICS COMMUNICATIONS, 2017, 404 : 189 - 195
  • [49] Light field super-resolution using complementary-view feature attention
    Wei Zhang
    Wei Ke
    Da Yang
    Hao Sheng
    Zhang Xiong
    Computational Visual Media, 2023, 9 : 843 - 858
  • [50] High-Order Residual Network for Light Field Super-Resolution
    Meng, Nan
    Wu, Xiaofei
    Liu, Jianzhuang
    Lam, Edmund
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11757 - 11764