Quantizability and learning complexity in multilayer neural networks

被引：1

作者：

Fu, LM ^{[1
]}

机构：

[1] Univ Florida, Dept Comp & Informat Sci, Gainesville, FL 32611 USA

来源：

IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS | 1998年 / 28卷 / 02期

基金：

美国国家科学基金会;

关键词：

generalization; learning complexity; machine learning; neural network; quantizability; sample complexity;

D O I：

10.1109/5326.669575

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The relationship between quantizability and learning complexity in multilayer neural networks is examined. In a special neural network architecture that calculates node activations according to the certainty factor (CF) model of expert systems, the analysis based upon quantizability leads to lower and also better estimates for generalization dimensionality and sample complexity than those suggested by the multilayer perceptron model. This analysis is further supported by empirical simulation results.

引用

页码：295 / 300

页数：6

共 50 条

[21] A fast learning strategy for multilayer feedforward neural networks
Chen, Huawei
Zhong, Hualan
Yuan, Haiying
Jin, Fan
WCICA 2006: SIXTH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-12, CONFERENCE PROCEEDINGS, 2006, : 3019 - +
[22] SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks
Zenke, Friedemann
Ganguli, Surya
NEURAL COMPUTATION, 2018, 30 (06) : 1514 - 1541
[23] On the Computational Complexity of Learning Bithreshold Neural Units and Networks
Kotsovsky, Vladyslav
Geche, Fedir
Batyuk, Anatoliy
LECTURE NOTES IN COMPUTATIONAL INTELLIGENCE AND DECISION MAKING, 2020, 1020 : 189 - 202
[24] Effect of complexity on learning ability of recurrent neural networks
N. Honma
K. Kitagawa
K. Abe
Artificial Life and Robotics, 1998, 2 (3) : 97 - 101
[25] Computational Complexity of Learning Neural Networks: Smoothness and Degeneracy
Daniely, Amit
Srebro, Nathan
Vardi, Gal
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
[26] A fast Heuristic Global Learning algorithm for multilayer neural networks
Cho, SY
Chow, TWS
NEURAL PROCESSING LETTERS, 1999, 9 (02) : 177 - 187
[27] GEOMETRICAL LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS IN A BINARY FIELD
PARK, SK
KIM, JH
IEEE TRANSACTIONS ON COMPUTERS, 1993, 42 (08) : 988 - 992
[28] Learning and production of speech pattern using multilayer neural networks
Komura, Mitsuo, 1600, (22):
[29] Review of Pseudoinverse Learning Algorithm for Multilayer Neural Networks and Applications
Wang, Jue
Guo, Ping
Xin, Xin
ADVANCES IN NEURAL NETWORKS - ISNN 2018, 2018, 10878 : 99 - 106
[30] Hybrid learning of mapping and its Jacobian in multilayer neural networks
Lee, JW
Oh, JH
NEURAL COMPUTATION, 1997, 9 (05) : 937 - 958

← 1 2 3 4 5 →