A Division Based Neuron for Neural Networks

被引:0
|
作者
Dixon, Jaelen [1 ]
Li, Jiang [1 ]
机构
[1] Howard Univ, Dept EECS, Washington, DC 20059 USA
来源
2024 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI 2024 | 2024年
关键词
D O I
10.1109/CAI59869.2024.00013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose an alternative neuron design for artificial neural networks that replaces wx+b in a typical neuron with w1x/w2x. The design allows more complex calculations, such as division, to be performed efficiently within a neural network, and thus more efficient and specialized prediction models to be made. Along with the new design, we developed an algorithm to dynamically adjust the learning rate for model training. The algorithms were tested in the training of single-layer and single-neuron models to predict the outcome of various division-based operations. The initial test results showed that the average prediction errors are between 0.0241% and 0.898%. That is significantly more accurate than traditional neural networks with more layers.
引用
收藏
页码:19 / 20
页数:2
相关论文
共 50 条
  • [31] Linear leaky-integrate-and-fire neuron model based spiking neural networks and its mapping relationship to deep neural networks
    Lu, Sijia
    Xu, Feng
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [32] Single neuron-based neural networks are as efficient as dense deep neural networks in binary and multi-class recognition problems
    Khalifa, Yassin
    Hawks, Justin
    Sejdic, Ervin
    BIG DATA III: LEARNING, ANALYTICS, AND APPLICATIONS, 2021, 11730
  • [33] Global Concept-Based Interpretability for Graph Neural Networks via Neuron Analysis
    Han Xuanyuan
    Barbiero, Pietro
    Georgiev, Dobrik
    Magister, Lucie Charlotte
    Lio, Pietro
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10675 - 10683
  • [34] Phase Transition Oxide Neuron for Spiking Neural Networks
    Jerry, Matthew
    Tsai, Wei-yu
    Xie, Baihua
    Lie, Xueqing
    Narayanan, Vijay
    Raychowdhury, Arijit
    Datta, Suman
    2016 74TH ANNUAL DEVICE RESEARCH CONFERENCE (DRC), 2016,
  • [35] Diverse Neuron Type Selection for Convolutional Neural Networks
    Zhu, Guibo
    Zhang, Zhaoxiang
    Zhang, Xu-Yao
    Liu, Cheng-Lin
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3560 - 3566
  • [36] Hardware neuron models with CMOS for auditory neural networks
    Saeki, K
    Iidaka, R
    Sekine, Y
    Aihara, K
    ICONIP'02: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING: COMPUTATIONAL INTELLIGENCE FOR THE E-AGE, 2002, : 1325 - 1329
  • [37] ACCIDENTAL MIGRATIONS IN NEURAL NETWORKS, AND NEURON MODELS OF MEMORY
    KUZNETSO.LS
    PETUNIN, YI
    MITYAGIN, LS
    TEORIYA VEROYATNOSTEI I YEYE PRIMENIYA, 1972, 17 (04): : 790 - &
  • [38] IC neuron: An efficient unit to construct neural networks
    An, Junyi
    Liu, Fengshan
    Shen, Furao
    Zhao, Jian
    Li, Ruotong
    Gao, Kepan
    NEURAL NETWORKS, 2022, 145 : 177 - 188
  • [39] The role of neuron transfer function in artificial neural networks
    Wang Rui-Min
    Zhao Hong
    ACTA PHYSICA SINICA, 2007, 56 (02) : 730 - 739
  • [40] Neuron Dependency Graphs: A Causal Abstraction of Neural Networks
    Hu, Yaojie
    Tian, Jin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,