Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [1] Geometry-assisted multi-representation view reconstruction network for Light Field image angular super-resolution
    Liu, Deyang
    Tong, Zaidong
    Huang, Yan
    Chen, Yilei
    Zuo, Yifan
    Fang, Yuming
    KNOWLEDGE-BASED SYSTEMS, 2023, 267
  • [2] Light field angular super-resolution by view-specific queries
    Wang, Shunzhou
    Lu, Yao
    Xia, Wang
    Xia, Peiqi
    Wang, Ziqi
    Gao, Wei
    VISUAL COMPUTER, 2024, : 3565 - 3580
  • [3] Learning Light Field Angular Super-Resolution via a Geometry-Aware Network
    Jin, Jing
    Hou, Junhui
    Yuan, Hui
    Kwong, Sam
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11141 - 11148
  • [4] Angular-flexible network for light field image super-resolution
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    ELECTRONICS LETTERS, 2021, 57 (24) : 921 - 924
  • [5] Light Field Angular Super-Resolution using Convolutional Neural Network with Residual Network
    Kim, Dong-Myung
    Kang, Hyun-Soo
    Hong, Jang-Eui
    Suh, Jae-Won
    2019 ELEVENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2019), 2019, : 595 - 597
  • [6] Multiview Light Field Angular Super-Resolution Based on View Alignment and Frequency Attention
    Liu, Deyang
    Mao, Yifan
    Zhang, Youzhi
    Zheng, Xin
    Zuo, Yifan
    Fang, Yuming
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 343 - 356
  • [7] Light Field Angular Super-Resolution Network Based on Convolutional Transformer and Deep Deblurring
    Liu, Deyang
    Mao, Yifan
    Zuo, Yifan
    An, Ping
    Fang, Yuming
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1736 - 1748
  • [8] A Coarse-to-Fine Convolutional Neural Network for Light Field Angular Super-Resolution
    Liu, Gaosheng
    Yue, Huanjing
    Yang, Jingyu
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT I, 2022, 13604 : 268 - 279
  • [9] Epipolar plane images based light-field angular super-resolution network
    Su, Lijuan
    Ye, Zimu
    Sui, Yuxiao
    Yuan, Yan
    Liu, Anqi
    Zhu, Conghui
    SEVENTH ASIA PACIFIC CONFERENCE ON OPTICS MANUFACTURE (APCOM 2021), 2022, 12166
  • [10] Light Field Image Super-Resolution Based on Multilevel Structures
    Park, Hwa-Jong
    Shin, Junho
    Kim, Hyunseop
    Koh, Yeong Jun
    IEEE ACCESS, 2022, 10 : 59135 - 59144