Polarization computational imaging super-resolution reconstruction with lightweight attention cascading network

被引:0
|
作者
Wang J. [1 ]
Xu G. [1 ,2 ,3 ]
Ma J. [1 ,2 ]
Wang Y. [3 ]
Li Y. [4 ]
机构
[1] School of Internet, Anhui University, Hefei
[2] National Engineering Research Center for Agro-Ecological Big Data Analysis & Application, Anhui University, Hefei
[3] Anhui Province Key Laboratory of Polarized Imaging Detecting Technology, Army Artillery and Air Defense Forces Academy of PLA, Hefei
[4] Institute of Intelligent Technology, Anhui Wenda University of Information Engineering, Hefei
关键词
cascade connections; computational imaging; lightweight network; polarization images; super-resolution;
D O I
10.37188/OPE.20223019.2404
中图分类号
学科分类号
摘要
The new polarization computational imaging method in deep learning mode leads to higher computational complexity and memory usage as the network depth increases and results in insufficient hierarchical feature extraction. To this end, a lightweight polarization computational imaging super-resolution network with cascade attention is proposed that requires fewer parameters and a lower computational complexity while ensuring the reconstruction accuracy. First, cascade and fusion connections are used to deepen the representational capabilities of the convolution layers to effectively transfer shallow features and reduce the number of parameters. Second, a spatial attention adaptive weighting mechanism is designed to extract polarized multi-parameter spatial content features. A spatial pyramid network is then constructed to enhance the polarization feature information under multiple receptive fields. An upsampling module introduces the shallow and deep reconstruction paths and generates high-resolution polarization images by fusing the features of the two-layer paths. Finally, the network end information refines the blocks to learn finer features and enhance the reconstruction quality. Experiments show that the texture details of the reconstructed images using the proposed method are more abundant. The peak signal-to-noise ratio (PSNR) of two-times super-resolution on the full polarized image set is 45.12 dB, and the number of parameters is approximately 9% of that for a multi-scale residual network (MSRN). The proposed method effectively captures low-frequency feature information in a cascading manner while significantly reducing the number of parameters. Combined with the attention pyramid structure to explore deep features, an efficient super-resolution reconstruction is realized using a lightweight network. © 2022 Guangxue Jingmi Gongcheng/Optics and Precision Engineering. All rights reserved.
引用
收藏
页码:2404 / 2419
页数:15
相关论文
共 39 条
  • [1] WANG D J, SUN H, SUN X Q, Effect of extinction ratio and detector noise on polarization accuracy of nanometer wire grid polarization imaging system[J], Opt. Precision Eng, 26, 10, pp. 2371-2379, (2018)
  • [2] WANG X L, WANG F, LIU X, Hyperspectral polarization characteristics of typical camouflage target under desert background[J], Laser & Optoelectronics Progress, 55, 5, pp. 198-207, (2018)
  • [3] WANG S CH, ZHANG L, XUE M G, Optimization with demodulation algorithm for spatially modulated full polarization imaging system[J], Acta Photonica Sinica, 49, 12, pp. 152-162, (2020)
  • [4] HU Q Y, YANG W F, HU Y D, Principle and simulation of a spatially modulated full stokes parameters polarization imaging system[J], Acta Optica Sinica, 35, 2, pp. 152-158, (2015)
  • [5] WANG C, FAN ZH G, JIN H H, Design and optimization analysis of imaging system of polarized skylight pattern of full polarization[J], Acta Physica Sinica, 70, 10, pp. 123-131, (2021)
  • [6] WU Y, CHEN F SH, CHEN G L, Applicable conditions and improving spatial resolution upper limits of image restoration and super-resolution reconstruction[J], Journal of Infrared and Millimeter Waves, 29, 5, pp. 351-356, (2010)
  • [7] WU X T, YANG H, SUN X L, Image restoring method based on region selection network and its application in computational imaging[J], Opt. Precision Eng, 29, 4, pp. 864-876, (2021)
  • [8] XU G M, YUAN H W, XUE M G, Spatial modulation full polarization computing imaging super-resolution via scene transfer[J], Journal of Computer-Aided Design & Computer Graphics, 33, 9, pp. 1440-1449, (2021)
  • [9] ZHANG J, YUAN C G, HUANG G H, Acquisition of a full-resolution image and aliasing reduction for a spatially modulated imaging polarimeter with two snapshots[J], Applied Optics, 57, 10, pp. 2376-2382, (2018)
  • [10] MENG X CH, SUN W W, REN K, Spatial-spectral fusion of GF-5/GF-1 remote sensing images based on multiresolution analysis[J], Journal of Remote Sensing, 24, 4, pp. 379-387, (2020)