Retina-Inspired Lightweight Spiking Convolutional Neural Network for Single-Image Dehazing

被引:0
|
作者
Zhang, Ya [1 ]
Luo, Xiaoling [2 ]
Sun, Qian [1 ]
Wang, Yuchen [1 ]
Qu, Hong [1 ]
Yi, Zhang [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ Sci & Engn, Sch Comp Sci & Engn, Yibin 643000, Peoples R China
[3] Sichuan Univ, Coll Comp Sci, Chengdu, Peoples R China
基金
美国国家科学基金会;
关键词
Retina; Computer architecture; Atmospheric modeling; Microprocessors; Image reconstruction; Photoreceptors; Image color analysis; Biological information theory; Scattering; Roads; Biologically inspired vision; hazy image reconstruction; spiking convolution; spiking mechanism; CELL-TYPES; VISIBILITY; CIRCUITS; INFORMATION;
D O I
10.1109/TNNLS.2024.3460973
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Suspended particles in hazy medium absorb and scatter light, severely degrading imaging quality. Numerous single-image dehazing methods have been proposed to reconstruct clear images from hazy ones. However, most of them focus on increasing depth and width to improve dehazing performance, which incurs high computation and energy costs. To address this issue, we propose a lightweight spiking convolutional neural network (CNN) referred to as retina-inspired spiking CNN (RI-SCNN) for the reconstruction of hazy images. Unlike conventional dehazing techniques, first, our proposed network simulates the hierarchical structure and cellular function of the retina and devises five network modules to efficiently encode and extract image features through ON and OFF roads. Furthermore, the linear reconstruction mechanism is introduced to integrate the outputs from different roads, adaptively preserving regions with optimal details and constructing a comprehensive visual representation. Finally, by the transformed atmospheric scattering formula, our network can generate the dehazy image. Incorporating the microscale spiking mechanism of the brain, the entire network leverages discrete binary spike trains for information encoding and transmission, directly trained by spiking surrogate gradient learning on integrate-and-fire (IF) neurons. Experimental results demonstrate the superiority of the proposed RI-SCNN in terms of quantitative dehazing performance, qualitative visual effect, energy efficiency, and run speed. Considering its lightweight architecture with ultralow computation and energy costs, the network is encouraged to be deployed in the visual sensor hardware to improve overall performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Image dehazing using autoencoder convolutional neural network
    Richa Singh
    Ashwani Kumar Dubey
    Rajiv Kapoor
    International Journal of System Assurance Engineering and Management, 2022, 13 : 3002 - 3016
  • [32] Benchmarking Single-Image Dehazing and Beyond
    Li, Boyi
    Ren, Wenqi
    Fu, Dengpan
    Tao, Dacheng
    Feng, Dan
    Zeng, Wenjun
    Wang, Zhangyang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) : 492 - 505
  • [33] IAD-Net: Single-Image Dehazing Network Based on Image Attention
    Zhang, Zheqing
    Zhou, Hao
    Li, Chuan
    Jiang, Weiwei
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2024, E107D (10) : 1380 - 1384
  • [34] Gaussian RAM: Lightweight Image Classification via Stochastic Retina-Inspired Glimpse and Reinforcement Learning
    Shim, Dongseok
    Kim, H. Jin
    2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 155 - 160
  • [35] Multistage Progressive Single-Image Dehazing Network With Feature Physics Model
    Yin, Haitao
    Yang, Pengcheng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 12
  • [36] RGNAM: recurrent grid network with an attention mechanism for single-image dehazing
    Wang, Nian
    Cui, Zhigao
    Su, Yanzhao
    Li, Aihua
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [37] Multi-scale feature aggregation network for single-image dehazing
    Zhao, Donghui
    Mo, Bo
    Zhu, Xiang
    IET IMAGE PROCESSING, 2024, 18 (11) : 2943 - 2961
  • [38] GuidedNet: Single Image Dehazing Using an End-to-end Convolutional Neural Network
    Goncalves, Lucas T.
    Gaya, Joel O.
    Drews-, Paulo, Jr.
    Botelho, Silvia S. C.
    PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2018, : 79 - 86
  • [39] Simplified non-locally dense network for single-image dehazing
    Zhihua Chen
    Zhuoliang Hu
    Bin Sheng
    Ping Li
    Jinman Kim
    Enhua Wu
    The Visual Computer, 2020, 36 : 2189 - 2200
  • [40] Simplified non-locally dense network for single-image dehazing
    Chen, Zhihua
    Hu, Zhuoliang
    Sheng, Bin
    Li, Ping
    Kim, Jinman
    Wu, Enhua
    VISUAL COMPUTER, 2020, 36 (10-12): : 2189 - 2200