Two-level learning algorithm for multilayer neural networks

被引:1
|
作者
Liu, CS [1 ]
Tseng, CH [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Mech Engn, Appl Optimum Design Lab, Hsinchu 30050, Taiwan
关键词
D O I
10.1109/TAI.1998.744795
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A two-level learning algorithm that decomposes multilayer neural networks into a set of sub-networks is presented. A lot of popular optimization methods, such as conjugate-gradient and quasi-Neurton methods, cart be utilized to train these sub-networks. In addition, if the activation functions are hard-limiting functions, the multilayer neural networks can be trained by the perceptron learning rule in this two-level learning algorithm. Two experimental problems are given as examples for this algorithm.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [1] Two-Level Genetic Algorithm for Evolving Convolutional Neural Networks for Pattern Recognition
    Montecino, Daniel A.
    Perez, Claudio A.
    Bowyer, Kevin W.
    IEEE ACCESS, 2021, 9 : 126856 - 126872
  • [2] An algorithm of supervised learning for multilayer neural networks
    Tang, Z
    Wang, XG
    Tamura, H
    Ishii, M
    NEURAL COMPUTATION, 2003, 15 (05) : 1125 - 1142
  • [3] A two-level learning hierarchy for constructing incremental projection generalizing neural networks
    Murfi, H
    Kusumoputro, B
    APCCAS 2002: ASIA-PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, VOL 2, PROCEEDINGS, 2002, : 541 - 546
  • [4] Two-level branch prediction using neural networks
    Egan, C
    Steven, G
    Quick, P
    Anguera, R
    Steven, F
    Vintan, L
    JOURNAL OF SYSTEMS ARCHITECTURE, 2003, 49 (12-15) : 557 - 570
  • [5] Two-level adversarial attacks for graph neural networks
    Song, Chengxi
    Niu, Lingfeng
    Lei, Minglong
    INFORMATION SCIENCES, 2024, 654
  • [6] A two-level learning strategy based memetic algorithm for enhancing community robustness of networks
    Liu, Wenfeng
    Gong, Maoguo
    Wang, Shanfeng
    Ma, Lijia
    INFORMATION SCIENCES, 2018, 422 : 290 - 304
  • [7] A Two-Level Transfer Learning Algorithm for Evolutionary Multitasking
    Ma, Xiaoliang
    Chen, Qunjian
    Yu, Yanan
    Sun, Yiwen
    Ma, Lijia
    Zhu, Zexuan
    FRONTIERS IN NEUROSCIENCE, 2020, 13
  • [8] A Novel Two-Level Clustering-Based Differential Evolution Algorithm for Training Neural Networks
    Mousavirad, Seyed Jalaleddin
    Oliva, Diego
    Schaefer, Gerald
    Moghadam, Mahshid Helali
    El-Abd, Mohammed
    APPLICATIONS OF EVOLUTIONARY COMPUTATION, EVOAPPLICATIONS 2024, PT I, 2024, 14634 : 259 - 272
  • [9] The No-Prop algorithm: A new learning algorithm for multilayer neural networks
    Widrow, Bernard
    Greenblatt, Aaron
    Kim, Youngsik
    Park, Dookun
    NEURAL NETWORKS, 2013, 37 : 180 - 186