Partially connected feedforward neural networks structured by input types

被引:19
|
作者
Kang, S [1 ]
Isik, C
机构
[1] Informat & Commun Univ, Lab Multimedia Comp Commun & Broadcasting, Taejon 305714, South Korea
[2] Syracuse Univ, Dept Elect Engn & Comp Sci, Syracuse, NY 13244 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2005年 / 16卷 / 01期
关键词
fully connected neural network (FCNN); input sensitivity; input type (IT); partially connected neural network (PCNN);
D O I
10.1109/TNN.2004.839353
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes, a,new method to model partially connected feedforward neural networks (PCFNNs) from the identified input type (IT) which refers to whether each input is coupled with or uncoupled from other inputs in generating output. The identification is done by analyzing input sensitivity changes as amplifying the magnitude of inputs. The sensitivity changes of the uncoupled inputs are not correlated with the variation on any other input, while those of the coupled inputs are correlated with the variation on any one of the coupled inputs. According to the identified ITs, a PCFNN can be structured. Each uncoupled input does not share the neurons in the hidden layer with other inputs in order to contribute to output in an independent manner, while the coupled inputs share the neurons with one another. After deriving the mathematical input sensitivity analysis for each IT, several experiments, as well as a real example (blood pressure (BP) estimation), are described to demonstrate how well our method works.
引用
收藏
页码:175 / 184
页数:10
相关论文
共 50 条
  • [1] Partially connected feedforward neural networks on Apollonian networks
    Wong, W. K.
    Guo, Z. X.
    Leung, S. Y. S.
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2010, 389 (22) : 5298 - 5307
  • [2] PARTIALLY CONNECTED MODELS OF NEURAL NETWORKS
    CANNING, A
    GARDNER, E
    JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (15): : 3275 - 3284
  • [3] Input Layer Regularization of Multilayer Feedforward Neural Networks
    Li, Feng
    Zurada, Jacek M.
    Liu, Yan
    Wu, Wei
    IEEE ACCESS, 2017, 5 : 10979 - 10985
  • [4] A constructive algorithm to synthesize arbitrarily connected feedforward neural networks
    Puma-Villanueva, Wilfredo J.
    dos Santos, Euripedes P.
    Von Zuben, Fernando J.
    NEUROCOMPUTING, 2012, 75 (01) : 14 - 32
  • [5] Constructive algorithm for fully connected cascade feedforward neural networks
    Qiao, Junfei
    Li, Fanjun
    Han, Honggui
    Li, Wenjing
    NEUROCOMPUTING, 2016, 182 : 154 - 164
  • [6] LEARNING IN NEURAL NETWORKS WITH PARTIALLY STRUCTURED SYNAPTIC TRANSITIONS
    BATTAGLIA, FP
    FUSI, S
    NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1995, 6 (02) : 261 - 270
  • [7] Fully Connected Feedforward Neural Networks Based CSI Feedback Algorithm
    Ming Gao
    Tanming Liao
    Yubin Lu
    中国通信, 2021, 18 (01) : 43 - 48
  • [8] Fully Connected Feedforward Neural Networks Based CSI Feedback Algorithm
    Gao, Ming
    Liao, Tanming
    Lu, Yubin
    CHINA COMMUNICATIONS, 2021, 18 (01) : 43 - 48
  • [9] Regularizing the effect of input noise injection in feedforward neural networks training
    Abd-Krim Seghouane
    Yassir Moudden
    Gilles Fleury
    Neural Computing & Applications, 2004, 13 : 248 - 254
  • [10] Using input parameter influences to support the decisions of feedforward neural networks
    Howes, P
    Crook, N
    NEUROCOMPUTING, 1999, 24 (1-3) : 191 - 206