A Low-cost Implementation Method on Deep Neural Network Using Stochastic Computing

被引:0
|
作者
Dong, Ya [1 ,2 ]
Xiong, Xingzhong [1 ,2 ]
Li, Tianyu [1 ,2 ]
Zhang, Lin [1 ,2 ]
Chen, Jienan [3 ]
机构
[1] Sichuan Univ Sci & Engn, Sch Automat & Informat Engn, Yibin, Peoples R China
[2] Sichuan Univ Sci & Engn, Artificial Intelligence Key Lab Sichaun Prov, Yibin, Peoples R China
[3] Univ Elect Sci & Technol China, Natl Key Lab Sci & Technol Commun, Chengdu, Peoples R China
关键词
Hardware acceleration; spare computing; stochastic computing; high-efficiency multiplication and addition operations;
D O I
10.1117/12.2622719
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The deep neural network (DNN) as the computing core of the multiplication operation consumes a lot of hardware resources, which is not conducive to the development of DNN on a hardware platform with limited resources. In order to solve the above problems, this paper proposes an acceleration method of basing on a deep neural network (DNN) to accelerate multiplication operations on resource-constrained hardware platforms. This method can support sparse calculations to optimize calculation delays. At the same time, inspired by neurosynaptic plasticity and stochastic computing (SC), an acceleration method using simple logic gates for reasoning tasks is proposed. Experimental results show that the hardware resource consumption of the proposed acceleration method is 1.4 times lower than that of the traditional method solution in DNN.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] ZyNet: Automating Deep Neural Network Implementation on Low-cost Reconfigurable Edge Computing Platforms
    Vipin, Kizheppatt
    2019 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (ICFPT 2019), 2019, : 323 - 326
  • [2] VLSI Implementation of Deep Neural Network Using Integral Stochastic Computing
    Ardakani, Arash
    Leduc-Primeau, Francois
    Onizawa, Naoya
    Hanyu, Takahiro
    Gross, Warren J.
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2017, 25 (10) : 2688 - 2699
  • [3] FPGA-based implementation of deep neural network using stochastic computing
    Nobari, Maedeh
    Jahanirad, Hadi
    APPLIED SOFT COMPUTING, 2023, 137
  • [4] Low Cost Implementation of Neural Networks Based on Stochastic Computing
    Jahanirad, Hadi
    Menbari, Ahmad
    2021 29TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2021, : 94 - 97
  • [5] An Energy-Efficient Bayesian Neural Network Implementation Using Stochastic Computing Method
    Jia, Xiaotao
    Gu, Huiyi
    Liu, Yuhao
    Yang, Jianlei
    Wang, Xueyan
    Pan, Weitao
    Zhang, Youguang
    Cotofana, Sorin
    Zhao, Weisheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12913 - 12923
  • [6] Low-Cost Stochastic Number Generators for Stochastic Computing
    Salehi, Sayed Ahmad
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (04) : 992 - 1001
  • [7] A Low-Cost Image Encryption Method to Prevent Model Stealing of Deep Neural Network
    Jiang, Wei
    Gong, Zicheng
    Zhan, Jinyu
    He, Zhiyuan
    Pan, Weijia
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (16)
  • [8] VLSI Implementation of Deep Neural Networks Using Integral Stochastic Computing
    Ardakani, Arash
    Leduc-Primeau, Fracois
    Onizawa, Naoya
    Hanyu, Takahiro
    Gross, Warren J.
    2016 9TH INTERNATIONAL SYMPOSIUM ON TURBO CODES AND ITERATIVE INFORMATION PROCESSING (ISTC), 2016, : 216 - 220
  • [9] Hardware Implementation of an Improved Stochastic Computing Based Deep Neural Network Using Short Sequence Length
    Xiong, Haifei
    Abu Bakar, Muhammad
    He, Guanghui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (11) : 2667 - 2671
  • [10] Low-correlation Low-cost Stochastic Number Generators for Stochastic Computing
    Salehi, Sayed Ahmad
    2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,