High accuracy FPGA activation function implementation for neural networks

被引：21
|
作者：
Hajduk, Zbigniew [1 ]
机构：
[1] Rzeszow Univ Technol, Ul Powstancow Warszawy 12, PL-35959 Rzeszow, Poland
来源：
NEUROCOMPUTING | 2017年 / 247卷
关键词：
FPGA; Hyperbolic tangent; Sigmoid; Floating point arithmetic; HARDWARE IMPLEMENTATION;
D O I：
10.1016/j.neucom.2017.03.044
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This letter shortly presents an FPGA implementation method of the hyperbolic tangent and sigmoid activation functions for artificial neural networks. A kind of a direct implementation of the functions is proposed. The implementation results show that the obtained accuracy of the method is relatively high compared to other published solutions. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码：59 / 61
页数：3
相关论文
共 50 条
  • [31] Optimizing Neural Networks for Efficient FPGA Implementation: A Survey
    Riadh Ayachi
    Yahia Said
    Abdessalem Ben Abdelali
    Archives of Computational Methods in Engineering, 2021, 28 : 4537 - 4547
  • [32] Fast and Efficient Implementation of Convolutional Neural Networks on FPGA
    Podili, Abhinav
    Zhang, Chi
    Prasanna, Viktor
    2017 IEEE 28TH INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP), 2017, : 11 - 18
  • [33] Efficient Hardware Implementation of Artificial Neural Networks on FPGA
    Khalil, Kasem
    Mohaidat, Tamador
    Darwich, Mahmoud
    Kumar, Ashok
    Bayoumi, Magdy
    2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024, 2024, : 233 - 237
  • [34] Development of FPGA Toolbox for Implementation of Spiking Neural Networks
    Wu, QingXiang
    Liao, Xiaodong
    Huang, Xi
    Cai, Rongtai
    Cai, Jianyong
    Liu, Jinqing
    2015 FIFTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT2015), 2015, : 806 - 810
  • [35] FPGA implementation of a face detector using neural networks
    Lee, Yongsoon
    Ko, Seok-Bum
    2006 CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, VOLS 1-5, 2006, : 1679 - +
  • [36] Fully parallel implementation of spiking neural networks on FPGA
    Bako, L.
    Brassai, S. T.
    Szekely, I.
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON OPTIMIZATION OF ELECTRICAL AND ELECTRONIC EQUIPMENT, VOL III: INDUSTRIAL AUTOMATION AND CONTROL, 2006, : 135 - 142
  • [37] Optimizing Neural Networks for Efficient FPGA Implementation: A Survey
    Ayachi, Riadh
    Said, Yahia
    Ben Abdelali, Abdessalem
    ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2021, 28 (07) : 4537 - 4547
  • [38] Accuracy Analysis of Node Activation Function Based on Hardware Implementation of Artificial Neural Network
    Jiang, Nan
    Hou, Ligang
    Guo, Jia
    Zhang, Xinyi
    Lv, Ang
    2018 3RD IEEE INTERNATIONAL CONFERENCE ON INTEGRATED CIRCUITS AND MICROSYSTEMS (ICICM), 2018, : 278 - 281
  • [39] EFFICIENT IMPLEMENTATION OF PIECEWISE LINEAR ACTIVATION FUNCTION FOR DIGITAL VLSI NEURAL NETWORKS
    MYERS, DJ
    HUTCHINSON, RA
    ELECTRONICS LETTERS, 1989, 25 (24) : 1662 - 1663
  • [40] High speed, programmable implementation of a tanh-like activation function and its derivative for digital neural networks
    Marra, S.
    Iachino, M. A.
    Morabito, F. C.
    2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 506 - 511
12345