Analog versus discrete neural networks

被引:8
|
作者
DasGupta, B [1 ]
Schnitger, G [1 ]
机构
[1] UNIV FRANKFURT,FACHBEREICH INFORMAT 20,D-60054 FRANKFURT,GERMANY
关键词
D O I
10.1162/neco.1996.8.4.805
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show that neural networks with three-times continuously differentiable activation functions are capable of computing a certain family of n-bit Boolean functions with two gates, whereas networks composed of binary threshold functions require at least Omega(log n) gates. Thus, for a large class of activation functions, analog neural networks can be more powerful than discrete neural networks, even when computing Boolean functions.
引用
收藏
页码:805 / 818
页数:14
相关论文
共 50 条
  • [1] On analog implementation of discrete neural networks
    Beiu, V
    Moore, KR
    FUZZY LOGIC AND INTELLIGENT TECHNOLOGIES FOR NUCLEAR SCIENCE AND INDUSTRY, 1998, : 258 - 265
  • [2] Analog stable simulation of discrete neural networks
    Sima, Jiri
    Neural Network World, 1997, 7 (06) : 679 - 686
  • [3] AN ANALOG IMPLEMENTATION OF DISCRETE-TIME CELLULAR NEURAL NETWORKS
    HARRER, H
    NOSSEK, JA
    STELZL, R
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (03): : 466 - 476
  • [4] Discrete optimization using analog neural networks with discontinuous dynamics
    Vidyasagar, M
    STABILITY THEORY: HURWITZ CENTENARY CONFERENCE, CENTRO STEFANO FRANSCINI, ASCONA, 1995, 1996, 121 : 107 - 112
  • [5] Globally asymptotical stability of discrete-time analog neural networks
    Jin, LA
    Gupta, MM
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (04): : 1024 - 1031
  • [6] ANALOG NEURAL NETWORKS
    HASLER, M
    ARTIFICIAL NEURAL NETWORKS : JOURNEES DELECTRONIQUE 1989, 1989, : 61 - 75
  • [7] ANALOG IMPLEMENTATION OF NEURAL NETWORKS
    ZURADA, JM
    IEEE CIRCUITS AND DEVICES MAGAZINE, 1992, 8 (05): : 36 - 41
  • [8] PROPERTIES OF ANALOG NEURAL NETWORKS
    NOGUCHI, S
    TANAKA, A
    SUGAWARA, K
    JOURNAL OF CYBERNETICS, 1980, 10 (04): : 265 - 281
  • [9] Are analog neural networks better than binary neural networks?
    M. Vidyasagar
    Circuits, Systems and Signal Processing, 1998, 17 : 243 - 270
  • [10] Are analog neural networks better than binary neural networks?
    Vidyasagar, M
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 1998, 17 (02) : 243 - 270