Quantizability and learning complexity in multilayer neural networks

被引：1
|
作者：
Fu, LM [1 ]
机构：
[1] Univ Florida, Dept Comp & Informat Sci, Gainesville, FL 32611 USA
来源：
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS | 1998年 / 28卷 / 02期
基金：
美国国家科学基金会;
关键词：
generalization; learning complexity; machine learning; neural network; quantizability; sample complexity;
D O I：
10.1109/5326.669575
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
The relationship between quantizability and learning complexity in multilayer neural networks is examined. In a special neural network architecture that calculates node activations according to the certainty factor (CF) model of expert systems, the analysis based upon quantizability leads to lower and also better estimates for generalization dimensionality and sample complexity than those suggested by the multilayer perceptron model. This analysis is further supported by empirical simulation results.
引用
收藏
页码：295 / 300
页数：6
相关论文
共 50 条
  • [1] On the Complexity of Learning Neural Networks
    Song, Le
    Vempala, Santosh
    Wilmes, John
    Xie, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [2] Learning with regularizers in multilayer neural networks
    Saad, D
    Rattray, M
    PHYSICAL REVIEW E, 1998, 57 (02) : 2170 - 2176
  • [3] Optimal learning in multilayer neural networks
    Winther, O.
    Lautrup, B.
    Zhang, J.-B.
    Physical Review E. Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics, 1997, 55 (1-B pt B):
  • [4] Optimal learning in multilayer neural networks
    Winther, O
    Lautrup, B
    Zhang, JB
    PHYSICAL REVIEW E, 1997, 55 (01) : 836 - 844
  • [5] LEARNING ALGORITHMS FOR MULTILAYER NEURAL NETWORKS
    AVEDYAN, ED
    AUTOMATION AND REMOTE CONTROL, 1995, 56 (04) : 541 - 551
  • [6] Taming Nuclear Complexity with a Committee of Multilayer Neural Networks
    Lasseri, Raphael-David
    Regnier, David
    Ebran, Jean-Paul
    Penon, Antonin
    PHYSICAL REVIEW LETTERS, 2020, 124 (16)
  • [7] Complexity of learning in artificial neural networks
    Engel, A
    THEORETICAL COMPUTER SCIENCE, 2001, 265 (1-2) : 285 - 306
  • [8] An algorithm of supervised learning for multilayer neural networks
    Tang, Z
    Wang, XG
    Tamura, H
    Ishii, M
    NEURAL COMPUTATION, 2003, 15 (05) : 1125 - 1142
  • [9] Effect of batch learning in multilayer neural networks
    Fukumizu, K
    ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, 1998, : 67 - 70
  • [10] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
12345