Quantization-Aware Training of Spiking Neural Networks for Energy-Efficient Spectrum Sensing on Loihi Chip

被引:1
|
作者
Liu, Shiya [1 ]
Mohammadi, Nima [1 ]
Yi, Yang [1 ]
机构
[1] Virginia Tech, Bradley Dept Elect & Comp Engn, Blacksburg, VA 24061 USA
基金
美国国家科学基金会;
关键词
Spectrum sensing; spiking neural networks; quantization; quantization-aware training; OPTIMIZATION;
D O I
10.1109/TGCN.2023.3337748
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Spectrum sensing is a technique used to identify idle/busy bandwidths in cognitive radio. Energy-efficient spectrum sensing is critical for multiple-input-multiple-output (MIMO) orthogonal-frequency-division multiplexing (OFDM) systems. In this paper, we propose the use of spiking neural networks (SNNs), which are more biologically plausible and energy-efficient than deep neural networks (DNNs), for spectrum sensing. The SNN models are implemented on the Loihi chip, which is better suited for SNNs than GPUs. Quantization is an effective technique to reduce the memory and energy consumption of SNNs. However, previous quantization methods for SNNs have suffered from accuracy degradation when compared to full-precision models. This degradation can be attributed to errors introduced by the coarse estimation of gradients in non-differentiable quantization layers. To address this issue, we introduce a quantization-aware training algorithm for SNNs running on Loihi. To mitigate errors caused by the poor estimation of gradients, we do not use a fixed configuration for the quantizer, as is common in existing SNN quantization methods. Instead, we make the scale parameters of the quantizer trainable. Furthermore, our proposed method adopts a probability-based scheme to selectively quantize individual layers within the network, rather than quantizing all layers simultaneously. Our experimental results demonstrate that high-performance and energy-efficient spectrum sensing can be achieved using Loihi.
引用
收藏
页码:827 / 838
页数:12
相关论文
共 50 条
  • [21] Comparative Study on Quantization-Aware Training of Memristor Crossbars for Reducing Inference Power of Neural Networks at The Edge
    Tien Van Nguyen
    An, Jiyong
    Min, Kyeong-Sik
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [22] Energy-efficient spectrum sensing for cognitive sensor networks
    Maleki, Sina
    Pandharipande, Ashish
    Leus, Geert
    IECON: 2009 35TH ANNUAL CONFERENCE OF IEEE INDUSTRIAL ELECTRONICS, VOLS 1-6, 2009, : 2494 - +
  • [23] Energy-Efficient Spectrum Sensing for Cognitive Radio Networks
    Su, Hang
    Zhang, Xi
    2010 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2010,
  • [24] Conversion of Siamese networks to spiking neural networks for energy-efficient object tracking
    Luo, Yihao
    Shen, Haibo
    Cao, Xiang
    Wang, Tianjiang
    Feng, Qi
    Tan, Zehan
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (12): : 9967 - 9982
  • [25] Conversion of Siamese networks to spiking neural networks for energy-efficient object tracking
    Yihao Luo
    Haibo Shen
    Xiang Cao
    Tianjiang Wang
    Qi Feng
    Zehan Tan
    Neural Computing and Applications, 2022, 34 : 9967 - 9982
  • [26] Quantization and sparsity-aware processing for energy-efficient NVM-based convolutional neural networks
    Bao, Han
    Qin, Yifan
    Chen, Jia
    Yang, Ling
    Li, Jiancong
    Zhou, Houji
    Li, Yi
    Miao, Xiangshui
    FRONTIERS IN ELECTRONICS, 2022, 3
  • [27] Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
    Yongqiang Cao
    Yang Chen
    Deepak Khosla
    International Journal of Computer Vision, 2015, 113 : 54 - 66
  • [28] Energy-efficient Hardware Design for Spiking Neural Networks (Extended Abstract)
    Moitra, Abhishek
    Yin, Ruokai
    Panda, Priyadarshini
    FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, 2023, : 543 - 544
  • [29] SiamSNN: Siamese Spiking Neural Networks for Energy-Efficient Object Tracking
    Luo, Yihao
    Xu, Min
    Yuan, Caihong
    Cao, Xiang
    Zhang, Liangqi
    Xu, Yan
    Wang, Tianjiang
    Feng, Qi
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2021, PT V, 2021, 12895 : 182 - 194
  • [30] Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition
    Cao, Yongqiang
    Chen, Yang
    Khosla, Deepak
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) : 54 - 66