Two-level learning algorithm for multilayer neural networks

被引:1
|
作者
Liu, CS [1 ]
Tseng, CH [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Mech Engn, Appl Optimum Design Lab, Hsinchu 30050, Taiwan
关键词
D O I
10.1109/TAI.1998.744795
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A two-level learning algorithm that decomposes multilayer neural networks into a set of sub-networks is presented. A lot of popular optimization methods, such as conjugate-gradient and quasi-Neurton methods, cart be utilized to train these sub-networks. In addition, if the activation functions are hard-limiting functions, the multilayer neural networks can be trained by the perceptron learning rule in this two-level learning algorithm. Two experimental problems are given as examples for this algorithm.
引用
收藏
页码:97 / 102
页数:6
相关论文
共 50 条
  • [21] Two-Level Scheduling Algorithm for Different Classes of Traffic in WiMAX Networks
    Ahmed, Zeeshan
    Hamma, Salima
    2012 INTERNATIONAL SYMPOSIUM ON PERFORMANCE EVALUATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (SPECTS), 2012,
  • [22] A Genetic Algorithm for the Two-level Location Area Planning in Telecommunication Networks
    Abdelkhalek, Ons
    Krichen, Saoussen
    Guitouni, Adel
    2013 5TH INTERNATIONAL CONFERENCE ON MODELING, SIMULATION AND APPLIED OPTIMIZATION (ICMSAO), 2013,
  • [23] IMPROVED LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS AND HANDWRITTEN NUMERAL RECOGNITION
    YAMADA, K
    NEC RESEARCH & DEVELOPMENT, 1990, (98): : 81 - 88
  • [24] THE OFFSET ALGORITHM - BUILDING AND LEARNING-METHOD FOR MULTILAYER NEURAL NETWORKS
    MARTINEZ, D
    ESTEVE, D
    EUROPHYSICS LETTERS, 1992, 18 (2BIS): : 95 - 100
  • [25] Least square based constructive learning algorithm for multilayer neural networks
    Li, Jianghong
    Hu, Zhaowen
    Changsha Dianli Xueyuan Xuebao/Journal of Changsha University of Electric Power, 1999, 14 (02): : 127 - 131
  • [26] LYAPUNOV THEORY BASED ADAPTIVE LEARNING ALGORITHM FOR MULTILAYER NEURAL NETWORKS
    Acir, Nurettin
    Menguc, Engin Cemal
    NEURAL NETWORK WORLD, 2014, 24 (06) : 619 - 636
  • [27] Two-Level Graph Neural Network
    Ai, Xing
    Sun, Chengyu
    Zhang, Zhihong
    Hancock, Edwin R.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4593 - 4606
  • [28] TwoResNet: Two-level resolution neural network for traffic forecasting on freeway networks
    Li, Danya
    Kwak, Semin
    Geroliminis, Nikolas
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 3963 - 3969
  • [29] Fast BATLLNN: Fast Box Analysis of Two-Level Lattice Neural Networks
    Ferlez, James
    Khedr, Haitham
    Shoukry, Yasser
    HSCC 2022: PROCEEDINGS OF THE 25TH ACM INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL (PART OF CPS-IOT WEEK 2022), 2022,
  • [30] Analysis and comparison of two-level KFAC methods for training deep neural networks
    Koroko, Abdoulaye
    Anciaux-Sedrakian, Ani
    Ben Gharbia, Ibtihel
    Gares, Valerie
    Haddou, Mounir
    Tran, Quang Huy
    OPTIMIZATION METHODS & SOFTWARE, 2024,