Parallel implementation of the feedforward back-propagation algorithm on pyramid networks

被引：0
|
作者：
Maelainin, SA
Bellaachia, A
机构：
来源：
PARALLEL AND DISTRIBUTED COMPUTING SYSTEMS - PROCEEDINGS OF THE ISCA 9TH INTERNATIONAL CONFERENCE, VOLS I AND II | 1996年
关键词：
pyramid; interconnection networks; neural networks; backpropagation; feedforward; hopfield network;
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this paper, we present a parallel implementation of the FeedForward BackPropagation algorithm on pyramids. The proposed algorithm is quite simple and easy to implement. For an ANN of L layers and a maximum of N nodes per layer, our algorithm requires a pyramid of (4N(2)-1)/3 processors to perform backpropagation algorithm in O(LN) time complexity. Note that our solution requires less than the number of nodes required by the best known solution for a mesh of appendixed trees topology of 3N(2) processors. In addition, the algorithm can be adapted to quadtrees with slight modifications. The technique used in our implementation can also be applied to the Hopfield network.
引用
收藏
页码：444 / 449
页数：6
相关论文
共 50 条
  • [21] The generalized back-propagation algorithm with convergence analysis
    Ng, SC
    Leung, SH
    Luk, A
    ISCAS '99: PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 5: SYSTEMS, POWER ELECTRONICS, AND NEURAL NETWORKS, 1999, : 612 - +
  • [22] A back-propagation algorithm with adaptive momentum factor
    Department of Applied Mathematics, Dalian University of Technology, Dalian 116024, China
    不详
    Dalian Haishi Daxue Xuebao, 2008, 4 (45-47+51):
  • [23] Error measures of the back-propagation learning algorithm
    Fujiki, S
    Nakao, M
    Fujiki, NM
    JOURNAL OF THE KOREAN PHYSICAL SOCIETY, 2002, 40 (06) : 1091 - 1095
  • [24] NEURAL CONTROLLER BASED ON BACK-PROPAGATION ALGORITHM
    SAERENS, M
    SOQUET, A
    IEE PROCEEDINGS-F RADAR AND SIGNAL PROCESSING, 1991, 138 (01) : 55 - 62
  • [25] Improving the training time of the back-propagation algorithm
    Mulawka, J.J.
    Verma, B.K.
    Microcomputer Applications, 1994, 13 (02): : 85 - 88
  • [26] An extension of the back-propagation algorithm to complex numbers
    Nitta, T
    NEURAL NETWORKS, 1997, 10 (08) : 1391 - 1415
  • [27] Optimizing back-propagation networks via a calibrated heuristic algorithm with an orthogonal array
    Wang, Tai-Yue
    Huang, Chien-Yu
    EXPERT SYSTEMS WITH APPLICATIONS, 2008, 34 (03) : 1630 - 1641
  • [28] Back-propagation algorithm with variable adaptive momentum
    Hameed, Alaa Ali
    Karlik, Bekir
    Salman, Mohammad Shukri
    KNOWLEDGE-BASED SYSTEMS, 2016, 114 : 79 - 87
  • [29] An Improved Back-Propagation Neural Network Algorithm
    Hao, Pan
    MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 4586 - 4590
  • [30] A generalized back-propagation algorithm for faster convergence
    Ng, SC
    Leung, SH
    Luk, A
    ICNN - 1996 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS. 1-4, 1996, : 409 - 413
12345