Accuracy Analysis of Node Activation Function Based on Hardware Implementation of Artificial Neural Network

被引:0
|
作者
Jiang, Nan [1 ]
Hou, Ligang [1 ]
Guo, Jia [1 ]
Zhang, Xinyi [1 ]
Lv, Ang [1 ]
机构
[1] Beijing Univ Technol, VLSI & Syst Lab, Beijing, Peoples R China
关键词
artificial neural network; VLSI; piecewise nonlinear approximation; bit level mapping;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One of the difficulties encountered in realizing artificial neural network based on VLSI is the choice of the implementation method of activation function. At present, the main approaches to solve this problem are piecewise nonlinear approximation and bit level mapping. Based on hyperbolic tangent, the final output error of the two methods is discussed through the hardware implementation and software analysis of the artificial neural network nodes. We found that the nonlinear approximation method has the problem of large output fluctuation, and the amplification effect of the backpropagation can not be ignored. Therefore, this paper proposes that the bit level mapping method has more advantages in practical applications in the implementation of high-precision artificial neural nodes.
引用
收藏
页码:278 / 281
页数:4
相关论文
共 50 条
  • [21] Multiplicative neuron model artificial neural network based on Gaussian activation function
    Gundogdu, Ozge
    Egrioglu, Erol
    Aladag, Cagdas Hakan
    Yolcu, Ufuk
    NEURAL COMPUTING & APPLICATIONS, 2016, 27 (04): : 927 - 935
  • [22] VLSI implementation of a neural network classifier based on the saturating linear activation function
    Bermak, A
    Bouzerdoum, A
    ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 981 - 985
  • [23] Hardware Implementation of Radial Basis Function Neural Network Based on Sigma-delta Modulation
    Guo Xiaodan
    Meng Qiao
    2014 9TH INTERNATIONAL SYMPOSIUM ON COMMUNICATION SYSTEMS, NETWORKS & DIGITAL SIGNAL PROCESSING (CSNDSP), 2014, : 1049 - 1053
  • [24] Digital hardware implementation of sigmoid function and its derivative for artificial neural networks
    Faiedh, H
    Gafsi, Z
    Besbes, K
    Torki, K
    ICM 2001: 13TH INTERNATIONAL CONFERENCE ON MICROELECTRONICS, PROCEEDINGS, 2001, : 189 - 192
  • [25] Hardware implementation of PCA neural network
    Nishizawa, K
    Hirai, Y
    ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, 1998, : 85 - 88
  • [26] Framework for neural network hardware implementation
    Brassai, Sandor Tihamer
    Hammas, Attila
    Bustya, Balazs
    2022 23RD INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2022, : 387 - 391
  • [27] Efficient Digital Implementation of The Sigmoidal Function For Artificial Neural Network
    Pratap, Rana
    Subadra, M.
    OPTICS: PHENOMENA, MATERIALS, DEVICES, AND CHARACTERIZATION: OPTICS 2011: INTERNATIONAL CONFERENCE ON LIGHT, 2011, 1391
  • [28] Scheduling algorithm of sensor network node based on artificial neural network
    Yang Wanggong
    Cheng Mingzhi
    INTERNATIONAL JOURNAL OF AUTONOMOUS AND ADAPTIVE COMMUNICATIONS SYSTEMS, 2021, 14 (03) : 279 - 290
  • [29] Fairness–accuracy tradeoff: activation function choice in a neural network
    Michael B. McCarthy
    Sundaraparipurnan Narayanan
    AI and Ethics, 2023, 3 (4): : 1423 - 1432
  • [30] A Unioned Graph Neural Network Based Hardware Trojan Node Detection
    Pan, Weitao
    Dong, Meng
    Wen, Cong
    Liu, Hongjin
    Zhang, Shaolin
    Shi, Bo
    Di, Zhixiong
    Qiu, Zhiliang
    Gao, Yiming
    Zheng, Ling
    IEICE ELECTRONICS EXPRESS, 2023,