Convergence of an online gradient method for BP neural networks with stochastic inputs

被引：0
|
作者：
Li, ZX
Wu, W [1 ]
Feng, GR
Lu, HF
机构：
[1] Dalian Univ Technol, Dept Appl Math, Dalian 116023, Peoples R China
[2] Dalian Maritime Univ, Dept Math, Dalian 116000, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Math, Shanghai 200000, Peoples R China
来源：
ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS | 2005年 / 3610卷
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
An online gradient method for BP neural networks is presented and discussed. The input training examples are permuted stochastically in each cycle of iteration. A monotonicity and a weak convergence of deterministic nature for the method are proved.
引用
收藏
页码：720 / 729
页数：10
相关论文
共 50 条
  • [21] CONVERGENCE OF GRADIENT METHOD WITH MOMENTUM FOR BACK-PROPAGATION NEURAL NETWORKS
    Wei Wu Department of Applied Mathematics
    JournalofComputationalMathematics, 2008, 26 (04) : 613 - 623
  • [22] Convergence of gradient method with momentum for back-propagation neural networks
    Wu, Wei
    Zhang, Naimin
    Li, Zhengxue
    Li, Long
    Liu, Yan
    JOURNAL OF COMPUTATIONAL MATHEMATICS, 2008, 26 (04) : 613 - 623
  • [23] Strong convergence of gradient methods for BP networks training
    Wu, W
    Shao, HM
    Qu, D
    PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 332 - 334
  • [24] Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks
    An, Jing
    Lu, Jianfeng
    arXiv, 2023,
  • [25] Ensemble Neural Networks (ENN): A gradient-free stochastic method
    Chen, Yuntian
    Chang, Haibin
    Meng, Jin
    Zhang, Dongxiao
    NEURAL NETWORKS, 2019, 110 : 170 - 185
  • [26] Damped Newton Stochastic Gradient Descent Method for Neural Networks Training
    Zhou, Jingcheng
    Wei, Wei
    Zhang, Ruizhi
    Zheng, Zhiming
    MATHEMATICS, 2021, 9 (13)
  • [27] Applications of fractional gradient descent method with adaptive momentum in BP neural networks
    Han, Xiaohui
    Dong, Jianping
    APPLIED MATHEMATICS AND COMPUTATION, 2023, 448
  • [28] Convergence of Stochastic Gradient Descent in Deep Neural Network
    Zhou, Bai-cun
    Han, Cong-ying
    Guo, Tian-de
    ACTA MATHEMATICAE APPLICATAE SINICA-ENGLISH SERIES, 2021, 37 (01): : 126 - 136
  • [29] Convergence of Stochastic Gradient Descent in Deep Neural Network
    Bai-cun Zhou
    Cong-ying Han
    Tian-de Guo
    Acta Mathematicae Applicatae Sinica, English Series, 2021, 37 : 126 - 136
  • [30] Convergence of Stochastic Gradient Descent in Deep Neural Network
    Bai-cun ZHOU
    Cong-ying HAN
    Tian-de GUO
    ActaMathematicaeApplicataeSinica, 2021, 37 (01) : 126 - 136
12345