Hardware implementation of neural network with Sigmoidal activation functions using CORDIC

被引:52
|
作者
Tiwari, Vipin [1 ]
Khare, Nilay [1 ]
机构
[1] MANIT, Dept Comp Sci & Engn, Bhopal, India
关键词
CORDIC; Field Programmable Gate Array (FPGA); Hardware; Neural network; FPGA IMPLEMENTATION; IDENTIFICATION; SYSTEMS;
D O I
10.1016/j.micpro.2015.05.012
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Activation function is the most important function in neural network processing. In this article, the field-programmable gate array (FPGA)-based hardware implementation of a multilayer feed-forward neural network, with a log sigmoid activation function and a tangent sigmoid (hyperbolic tangent) activation function has been presented, with more accuracy than any other previous implementation of a neural network with the same activation function. Accuracy is enhanced through the implementation of both the sigmoidal functions using COordinate Rotation Digital Computer (CORDIC) algorithm. The CORDIC algorithm is a simple and effective method for calculation of the trigonometric and hyperbolic functions. Simulations and experiments have been performed on the ISim simulation engine of the Xilinx Framework, using the Very High Speed Integrated Circuit Hardware Description Language (VHDL) as the programming language. The results show accuracy for a 32-bit and 64-bit input/output, compromising with speed. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:373 / 381
页数:9
相关论文
共 50 条
  • [11] Hardware implementation of a wavelet neural network using FPGAs
    Karabiyik, Ali
    Savran, Aydogan
    NEURAL INFORMATION PROCESSING, PT 3, PROCEEDINGS, 2006, 4234 : 1095 - 1104
  • [12] Hardware Implementation for Multiple Activation Functions
    Chang, Chih-Hsiang
    Kao, Hsu-Yu
    Huang, Shih-Hsu
    2019 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TW), 2019,
  • [13] Implementation of hyperbolic functions using CORDIC algorithm
    Boudabous, A
    Ghozzi, F
    Kharrat, MW
    Masmoudi, N
    16TH INTERNATIONAL CONFERENCE ON MICROELECTRONICS, PROCEEDINGS, 2004, : 738 - 741
  • [14] An optimized hardware implementation of the CORDIC algorithm
    Lyu, Fei
    Wu, Chaoran
    Wang, Yuxuan
    Pan, Hongbing
    Wang, Yu
    Luo, Yuanyong
    IEICE ELECTRONICS EXPRESS, 2022, 19 (21):
  • [15] High precision FPGA implementation of neural network activation functions
    Ortega-Zamorano, Francisco
    Jerez, Jose M.
    Juarez, Gustavo
    Perez, Jorge O.
    Franco, Leonardo
    2014 IEEE SYMPOSIUM ON INTELLIGENT EMBEDDED SYSTEMS (IES), 2014, : 55 - 60
  • [16] Hardware implementation of CMAC neural network using FPGA approach
    Chung, Chao-Ming
    Lin, Chih-Min
    Chiang, Ching-Tsan
    Yeung, Daniel S.
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 2005 - +
  • [17] Efficient Digital Implementation of The Sigmoidal Function For Artificial Neural Network
    Pratap, Rana
    Subadra, M.
    OPTICS: PHENOMENA, MATERIALS, DEVICES, AND CHARACTERIZATION: OPTICS 2011: INTERNATIONAL CONFERENCE ON LIGHT, 2011, 1391
  • [18] Hardware implementation of PCA neural network
    Nishizawa, K
    Hirai, Y
    ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, 1998, : 85 - 88
  • [19] Framework for neural network hardware implementation
    Brassai, Sandor Tihamer
    Hammas, Attila
    Bustya, Balazs
    2022 23RD INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2022, : 387 - 391
  • [20] Approximation results for neural network operators activated by sigmoidal functions
    Costarelli, Danilo
    Spigler, Renato
    NEURAL NETWORKS, 2013, 44 : 101 - 106