Retina-Inspired Lightweight Spiking Convolutional Neural Network for Single-Image Dehazing

被引:0
|
作者
Zhang, Ya [1 ]
Luo, Xiaoling [2 ]
Sun, Qian [1 ]
Wang, Yuchen [1 ]
Qu, Hong [1 ]
Yi, Zhang [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610054, Peoples R China
[2] Sichuan Univ Sci & Engn, Sch Comp Sci & Engn, Yibin 643000, Peoples R China
[3] Sichuan Univ, Coll Comp Sci, Chengdu, Peoples R China
基金
美国国家科学基金会;
关键词
Retina; Computer architecture; Atmospheric modeling; Microprocessors; Image reconstruction; Photoreceptors; Image color analysis; Biological information theory; Scattering; Roads; Biologically inspired vision; hazy image reconstruction; spiking convolution; spiking mechanism; CELL-TYPES; VISIBILITY; CIRCUITS; INFORMATION;
D O I
10.1109/TNNLS.2024.3460973
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Suspended particles in hazy medium absorb and scatter light, severely degrading imaging quality. Numerous single-image dehazing methods have been proposed to reconstruct clear images from hazy ones. However, most of them focus on increasing depth and width to improve dehazing performance, which incurs high computation and energy costs. To address this issue, we propose a lightweight spiking convolutional neural network (CNN) referred to as retina-inspired spiking CNN (RI-SCNN) for the reconstruction of hazy images. Unlike conventional dehazing techniques, first, our proposed network simulates the hierarchical structure and cellular function of the retina and devises five network modules to efficiently encode and extract image features through ON and OFF roads. Furthermore, the linear reconstruction mechanism is introduced to integrate the outputs from different roads, adaptively preserving regions with optimal details and constructing a comprehensive visual representation. Finally, by the transformed atmospheric scattering formula, our network can generate the dehazy image. Incorporating the microscale spiking mechanism of the brain, the entire network leverages discrete binary spike trains for information encoding and transmission, directly trained by spiking surrogate gradient learning on integrate-and-fire (IF) neurons. Experimental results demonstrate the superiority of the proposed RI-SCNN in terms of quantitative dehazing performance, qualitative visual effect, energy efficiency, and run speed. Considering its lightweight architecture with ultralow computation and energy costs, the network is encouraged to be deployed in the visual sensor hardware to improve overall performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Single Image Dehazing Using Neural Network
    Kaul, Kajal
    Sehgal, Smriti
    PROCEEDINGS OF THE CONFLUENCE 2020: 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING, 2020, : 205 - 211
  • [42] A modular organic neuromorphic spiking circuit for retina-inspired sensory coding and neurotransmitter-mediated neural pathways
    Matrone, Giovanni Maria
    van Doremaele, Eveline R. W.
    Surendran, Abhijith
    Laswick, Zachary
    Griggs, Sophie
    Ye, Gang
    McCulloch, Iain
    Santoro, Francesca
    Rivnay, Jonathan
    van de Burgt, Yoeri
    NATURE COMMUNICATIONS, 2024, 15 (01)
  • [43] Single-Image Crowd Counting via Multi-Column Convolutional Neural Network
    Zhang, Yingying
    Zhou, Desen
    Chen, Siqin
    Gao, Shenghua
    Ma, Yi
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 589 - 597
  • [44] Lightweight single image dehazing network with residual feature attention
    Bai, Yingshuang
    Li, Huiming
    Leng, Jing
    Luan, Yaqing
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [45] Single Image Dehazing Based on Multiple Convolutional Neural Networks
    Chen Q.-J.
    Zhang X.
    Zhang, Xue (zhangxueyanice@163.com), 1739, Science Press (47): : 1739 - 1748
  • [46] QCNN-H: Single-Image Dehazing Using Quaternion Neural Networks
    Frants, Vladimir
    Agaian, Sos
    Panetta, Karen
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (09) : 5448 - 5458
  • [47] A Nighttime and Daytime Single-Image Dehazing Method
    Tang, Yunqing
    Xiang, Yin
    Chen, Guangfeng
    APPLIED SCIENCES-BASEL, 2023, 13 (01):
  • [48] A Lightweight Convolutional Spiking Neural Network for Fires Detection Based on Acoustics
    Li, Xiaohuan
    Liu, Yi
    Zheng, Libo
    Zhang, Wenqiong
    ELECTRONICS, 2024, 13 (15)
  • [49] MADNet: A Fast and Lightweight Network for Single-Image Super Resolution
    Lan, Rushi
    Sun, Long
    Liu, Zhenbing
    Lu, Huimin
    Pang, Cheng
    Luo, Xiaonan
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (03) : 1443 - 1453
  • [50] IFE-Net: An Integrated Feature Extraction Network for Single-Image Dehazing
    Leng, Can
    Liu, Gang
    APPLIED SCIENCES-BASEL, 2023, 13 (22):