A Division Based Neuron for Neural Networks

被引:0
|
作者
Dixon, Jaelen [1 ]
Li, Jiang [1 ]
机构
[1] Howard Univ, Dept EECS, Washington, DC 20059 USA
来源
2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024 | 2024年
关键词
D O I
10.1109/CAI59869.2024.00013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an alternative neuron design for artificial neural networks that replaces wx+b in a typical neuron with w1x/w2x. The design allows more complex calculations, such as division, to be performed efficiently within a neural network, and thus more efficient and specialized prediction models to be made. Along with the new design, we developed an algorithm to dynamically adjust the learning rate for model training. The algorithms were tested in the training of single-layer and single-neuron models to predict the outcome of various division-based operations. The initial test results showed that the average prediction errors are between 0.0241% and 0.898%. That is significantly more accurate than traditional neural networks with more layers.
引用
收藏
页码:19 / 20
页数:2
相关论文
共 50 条
  • [1] Spiking Neural P Systems with Neuron Division
    Wang, Jun
    Hoogeboom, Hendrik Jan
    Pan, Linqiang
    MEMBRANE COMPUTING, 2010, 6501 : 361 - +
  • [2] Spiking neural P systems with neuron division and budding
    P■UN Gheorghe
    PREZ-JIMNEZ Mario J.
    ScienceChina(InformationSciences), 2011, 54 (08) : 1596 - 1607
  • [3] Spiking neural P systems with neuron division and budding
    Pan LinQiang
    Paun, Gheorghe
    Perez-Jimenez, Mario J.
    SCIENCE CHINA-INFORMATION SCIENCES, 2011, 54 (08) : 1596 - 1607
  • [4] Spiking Neural P Systems with Neuron Division and Dissolution
    Zhao, Yuzhen
    Liu, Xiyu
    Wang, Wenping
    PLOS ONE, 2016, 11 (09):
  • [5] Spiking neural P systems with neuron division and budding
    LinQiang Pan
    Gheorghe Păun
    Mario J. Pérez-Jiménez
    Science China Information Sciences, 2011, 54 : 1596 - 1607
  • [6] From the neuron doctrine to neural networks
    Yuste, Rafael
    NATURE REVIEWS NEUROSCIENCE, 2015, 16 (08) : 487 - 497
  • [7] From the neuron doctrine to neural networks
    Rafael Yuste
    Nature Reviews Neuroscience, 2015, 16 : 487 - 497
  • [8] From neuron to neural networks dynamics
    Cessac, B.
    Samuelides, M.
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2007, 142 (1): : 7 - 88
  • [9] From neuron to neural networks dynamics
    B. Cessac
    M. Samuelides
    The European Physical Journal Special Topics, 2007, 142 : 7 - 88
  • [10] Efficient Neuron Architecture for FPGA-based Spiking Neural Networks
    Wan, Lei
    Luo, Yuling
    Song, Shuxiang
    Harkin, Jim
    Liu, Junxiu
    2016 27TH IRISH SIGNALS AND SYSTEMS CONFERENCE (ISSC), 2016,