Retina-Inspired Lightweight Spiking Convolutional Neural Network for Single-Image Dehazing

被引:0
|
作者
Zhang, Ya [1 ]
Luo, Xiaoling [2 ]
Sun, Qian [1 ]
Wang, Yuchen [1 ]
Qu, Hong [1 ]
Yi, Zhang [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ Sci & Engn, Sch Comp Sci & Engn, Yibin 643000, Peoples R China
[3] Sichuan Univ, Coll Comp Sci, Chengdu, Peoples R China
基金
美国国家科学基金会;
关键词
Retina; Computer architecture; Atmospheric modeling; Microprocessors; Image reconstruction; Photoreceptors; Image color analysis; Biological information theory; Scattering; Roads; Biologically inspired vision; hazy image reconstruction; spiking convolution; spiking mechanism; CELL-TYPES; VISIBILITY; CIRCUITS; INFORMATION;
D O I
10.1109/TNNLS.2024.3460973
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Suspended particles in hazy medium absorb and scatter light, severely degrading imaging quality. Numerous single-image dehazing methods have been proposed to reconstruct clear images from hazy ones. However, most of them focus on increasing depth and width to improve dehazing performance, which incurs high computation and energy costs. To address this issue, we propose a lightweight spiking convolutional neural network (CNN) referred to as retina-inspired spiking CNN (RI-SCNN) for the reconstruction of hazy images. Unlike conventional dehazing techniques, first, our proposed network simulates the hierarchical structure and cellular function of the retina and devises five network modules to efficiently encode and extract image features through ON and OFF roads. Furthermore, the linear reconstruction mechanism is introduced to integrate the outputs from different roads, adaptively preserving regions with optimal details and constructing a comprehensive visual representation. Finally, by the transformed atmospheric scattering formula, our network can generate the dehazy image. Incorporating the microscale spiking mechanism of the brain, the entire network leverages discrete binary spike trains for information encoding and transmission, directly trained by spiking surrogate gradient learning on integrate-and-fire (IF) neurons. Experimental results demonstrate the superiority of the proposed RI-SCNN in terms of quantitative dehazing performance, qualitative visual effect, energy efficiency, and run speed. Considering its lightweight architecture with ultralow computation and energy costs, the network is encouraged to be deployed in the visual sensor hardware to improve overall performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Ultra-lightweight convolutional network for efficient single-image super-resolution
    Bai, Haomou
    Sang, Yue
    VISUAL COMPUTER, 2025,
  • [22] Single image dehazing based on convolutional neural network and multiple attention fusion
    Ming, Jinyi
    Cai, Zhidan
    Li, Shirong
    Bi, Sikai
    Ning, Yongxin
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)
  • [23] Single Image Dehazing Based on Convolutional Neural Network Using Boundary Constraint
    Lai, Yi
    Hua, Menghan
    Zhu, Tingge
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2021, 31 (04) : 616 - 624
  • [24] Multiscale implicit frequency selective network for single-image dehazing
    Wang, Zhibo
    Jia, Jia
    Min, Jeongik
    ETRI JOURNAL, 2024,
  • [25] Single Image Dehazing Based on Convolutional Neural Network Using Boundary Constraint
    Menghan Yi Lai
    Tingge Hua
    Pattern Recognition and Image Analysis, 2021, 31 : 616 - 624
  • [26] Haze-Aware Attention Network for Single-Image Dehazing
    Tong, Lihan
    Liu, Yun
    Li, Weijia
    Chen, Liyuan
    Chen, Erkang
    APPLIED SCIENCES-BASEL, 2024, 14 (13):
  • [27] Single Image Dehazing with a Generic Model-Agnostic Convolutional Neural Network
    Liu, Zheng
    Xiao, Botao
    Alrabeiah, Muhammad
    Wang, Keyan
    Chen, Jun
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (06) : 833 - 837
  • [28] Prior-guided multiscale network for single-image dehazing
    Wang, Nian
    Cui, Zhigao
    Su, Yanzhao
    He, Chuan
    Lan, Yunwei
    Li, Aihua
    IET IMAGE PROCESSING, 2021, 15 (13) : 3368 - 3379
  • [29] Image dehazing network based on improved convolutional neural network
    Dai C.
    International Journal of Manufacturing Technology and Management, 2024, 38 (4-5) : 302 - 320
  • [30] Image dehazing using autoencoder convolutional neural network
    Singh, Richa
    Dubey, Ashwani Kumar
    Kapoor, Rajiv
    INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2022, 13 (06) : 3002 - 3016