Retina-Inspired Lightweight Spiking Convolutional Neural Network for Single-Image Dehazing

被引:0
|
作者
Zhang, Ya [1 ]
Luo, Xiaoling [2 ]
Sun, Qian [1 ]
Wang, Yuchen [1 ]
Qu, Hong [1 ]
Yi, Zhang [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ Sci & Engn, Sch Comp Sci & Engn, Yibin 643000, Peoples R China
[3] Sichuan Univ, Coll Comp Sci, Chengdu, Peoples R China
基金
美国国家科学基金会;
关键词
Retina; Computer architecture; Atmospheric modeling; Microprocessors; Image reconstruction; Photoreceptors; Image color analysis; Biological information theory; Scattering; Roads; Biologically inspired vision; hazy image reconstruction; spiking convolution; spiking mechanism; CELL-TYPES; VISIBILITY; CIRCUITS; INFORMATION;
D O I
10.1109/TNNLS.2024.3460973
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Suspended particles in hazy medium absorb and scatter light, severely degrading imaging quality. Numerous single-image dehazing methods have been proposed to reconstruct clear images from hazy ones. However, most of them focus on increasing depth and width to improve dehazing performance, which incurs high computation and energy costs. To address this issue, we propose a lightweight spiking convolutional neural network (CNN) referred to as retina-inspired spiking CNN (RI-SCNN) for the reconstruction of hazy images. Unlike conventional dehazing techniques, first, our proposed network simulates the hierarchical structure and cellular function of the retina and devises five network modules to efficiently encode and extract image features through ON and OFF roads. Furthermore, the linear reconstruction mechanism is introduced to integrate the outputs from different roads, adaptively preserving regions with optimal details and constructing a comprehensive visual representation. Finally, by the transformed atmospheric scattering formula, our network can generate the dehazy image. Incorporating the microscale spiking mechanism of the brain, the entire network leverages discrete binary spike trains for information encoding and transmission, directly trained by spiking surrogate gradient learning on integrate-and-fire (IF) neurons. Experimental results demonstrate the superiority of the proposed RI-SCNN in terms of quantitative dehazing performance, qualitative visual effect, energy efficiency, and run speed. Considering its lightweight architecture with ultralow computation and energy costs, the network is encouraged to be deployed in the visual sensor hardware to improve overall performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A Fish Retina-Inspired Single Image Dehazing Method
    Zhang, Xian-Shi
    Yu, Yong-Bo
    Yang, Kai-Fu
    Li, Yong-Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 1875 - 1888
  • [2] Single-image Dehazing Algorithm Based on Convolutional Neural Networks
    Xiao, Jinsheng
    Luo, Li
    Liu, Enyu
    Lei, Junfeng
    Klette, Reinhard
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1259 - 1264
  • [3] A Cascaded Convolutional Neural Network for Single Image Dehazing
    Li, Chongyi
    Guo, Jichang
    Porikli, Fatih
    Fu, Huazhu
    Pang, Yanwei
    IEEE ACCESS, 2018, 6 : 24877 - 24887
  • [4] Dehaze-UNet: A Lightweight Network Based on UNet for Single-Image Dehazing
    Zhou, Hao
    Chen, Zekai
    Li, Qiao
    Tao, Tao
    ELECTRONICS, 2024, 13 (11)
  • [5] Single Image Dehazing Using Ranking Convolutional Neural Network
    Song, Yafei
    Li, Jia
    Wang, Xiaogang
    Chen, Xiaowu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (06) : 1548 - 1560
  • [6] Gabor feature processing in spiking neural networks from retina-inspired data
    Tsitiridis, Aristeidis
    Conde, Cristina
    Martin de Diego, Isaac
    del Rio Saez, Jose Sanchez
    Raul Gomez, Jorge
    Cabello, Enrique
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [7] Single-Image Super Resolution Using Convolutional Neural Network
    Symolon, William
    Dagli, Cihan
    BIG DATA, IOT, AND AI FOR A SMARTER FUTURE, 2021, 185 : 213 - 222
  • [8] Single-image super-resolution via a lightweight convolutional neural network with improved shuffle learning
    Lu, Xinbiao
    Xie, Xupeng
    Ye, Chunlin
    Xing, Hao
    Liu, Zecheng
    Chen, Yudan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 233 - 241
  • [9] Single-image super-resolution via a lightweight convolutional neural network with improved shuffle learning
    Xinbiao Lu
    Xupeng Xie
    Chunlin Ye
    Hao Xing
    Zecheng Liu
    Yudan Chen
    Signal, Image and Video Processing, 2024, 18 : 233 - 241
  • [10] Single-Image Dehazing via Compositional Adversarial Network
    Zhu, Hongyuan
    Cheng, Yi
    Peng, Xi
    Zhou, Joey Tianyi
    Kang, Zhao
    Lu, Shijian
    Fang, Zhiwen
    Li, Liyuan
    Lim, Joo-Hwee
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (02) : 829 - 838