Error bounds for approximation with neural networks

被引:43
|
作者
Burger, M [1 ]
Neubauer, A [1 ]
机构
[1] Johannes Kepler Univ Linz, Inst Ind Math, A-4040 Linz, Austria
基金
奥地利科学基金会;
关键词
neural networks; error bounds; nonlinear function approximation;
D O I
10.1006/jath.2001.3613
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In this paper we prove convergence rates for the problem of approximating functions f by neural networks and similar constructions. We show that the rates are the better the smoother the activation functions are, provided that f satisfies an integral representation. We give error bounds not only in Hilbert spaces but also in general Sobolev spaces W-m,W-r(Omega). Finally, we apply our results to a class of perceptrons and present a sufficient smoothness condition on f guaranteeing the integral representation, (C) 2001 Academic Press.
引用
收藏
页码:235 / 250
页数:16
相关论文
共 50 条
  • [11] APPROXIMATION AND ESTIMATION BOUNDS FOR ARTIFICIAL NEURAL NETWORKS
    BARRON, AR
    MACHINE LEARNING, 1994, 14 (01) : 115 - 133
  • [12] Lower bounds for approximation by MLP neural networks
    Maiorov, V
    Pinkus, A
    NEUROCOMPUTING, 1999, 25 (1-3) : 81 - 91
  • [13] Bounds on the Approximation Power of Feedforward Neural Networks
    Mehrabi, Mohammad
    Tchamkerten, Aslan
    Yousefi, Mansoor, I
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [14] The estimate for approximation error of spherical neural networks
    Cao, Feilong
    Wang, Huazhong
    Lin, Shaobo
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2011, 34 (15) : 1888 - 1895
  • [15] Approximation bounds for convolutional neural networks in operator learning
    Franco, Nicola Rares
    Fresca, Stefania
    Manzoni, Andrea
    Zunino, Paolo
    NEURAL NETWORKS, 2023, 161 : 129 - 141
  • [16] APPROXIMATION BOUNDS FOR RANDOM NEURAL NETWORKS AND RESERVOIR SYSTEMS
    Gonon, Lukas
    Grigoryeva, Lyudmila
    Ortega, Juan-pablo
    ANNALS OF APPLIED PROBABILITY, 2023, 33 (01): : 28 - 69
  • [17] Note on error bounds for function approximation using nonlinear networks
    Intel Corp, Folsom, United States
    Circ Syst Signal Process, 4 (449-457):
  • [18] A note on error bounds for function approximation using nonlinear networks
    Ajit T. Dingankar
    Irwin W. Sandberg
    Circuits, Systems and Signal Processing, 1998, 17 : 449 - 457
  • [19] A note on error bounds for function approximation using nonlinear networks
    Dingankar, AT
    Sandberg, IW
    40TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1 AND 2, 1998, : 1248 - 1251
  • [20] A note on error bounds for function approximation using nonlinear networks
    Dingankar, AT
    Sandberg, IW
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 1998, 17 (04) : 449 - 457