Risk-averting criteria for training neural networks

被引:0
|
作者
Lo, JTH [1 ]
机构
[1] Univ Maryland Baltimore Cty, Dept Math & Stat, Baltimore, MD 21228 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper shows that when a risk-averting error criterion is used to train a neural network or estimate a nonlinear regression model, as the risk-sensitivity index of the criterion increases. the domain on which the criterion is convex increases monotonically to the entire weight or parameter vector space R-N except the union of a finite number of manifolds whose dimensions are less than N. This paper also shows that inreasing the risk-sensitivity index reduces the maximum deviation of the outputs of the trained neural network or estimated regression model from the corresponding output measurements.
引用
收藏
页码:476 / 481
页数:6
相关论文
共 50 条
  • [31] Training Optimization for Artificial Neural Networks
    Toribio Luna, Primitivo
    Alejo Eleuterio, Roberto
    Valdovinos Rosas, Rosa Maria
    Rodriguez Mendez, Benjamin Gonzalo
    CIENCIA ERGO-SUM, 2010, 17 (03) : 313 - 317
  • [32] Training of a class of recurrent neural networks
    Shaaban, EM
    ISCAS '98 - PROCEEDINGS OF THE 1998 INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-6, 1998, : B78 - B81
  • [33] Training Neural Networks with Policy Gradient
    Bose, Sourabh
    Huber, Manfred
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 3998 - 4005
  • [34] On the Computational Efficiency of Training Neural Networks
    Livni, Roi
    Shalev-Shwartz, Shai
    Shamir, Ohad
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [35] Lifted Bregman Training of Neural Networks
    Wang, Xiaoyu
    Benning, Martin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [36] Nonsmooth training of fuzzy neural networks
    Eitzinger, C
    SOFT COMPUTING, 2004, 8 (06) : 443 - 448
  • [37] MULTILINGUAL TRAINING OF DEEP NEURAL NETWORKS
    Ghoshal, Arnab
    Swietojanski, Pawel
    Renals, Steve
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 7319 - 7323
  • [38] INVESTIGATIONS ON SEQUENCE TRAINING OF NEURAL NETWORKS
    Wiesler, Simon
    Golik, Pavel
    Schlueter, Ralf
    Ney, Hermann
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4565 - 4569
  • [39] A homotopy method for training neural networks
    Lendl, M
    Unbehauen, R
    Luo, FL
    SIGNAL PROCESSING, 1998, 64 (03) : 359 - 370
  • [40] Neural networks: Life after training
    Salerno, JJ
    1998 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5, 1998, : 1680 - 1685