Robust stochastic resonance for simple threshold neurons

被引:44
|
作者
Kosko, B [1 ]
Mitaim, S
机构
[1] Univ So Calif, Dept Elect Engn, Inst Signal & Image Proc, Los Angeles, CA 90089 USA
[2] Thammasat Univ, Fac Engn, Dept Elect Engn, Pathum Thani 12120, Thailand
来源
PHYSICAL REVIEW E | 2004年 / 70卷 / 03期
基金
美国国家科学基金会;
关键词
D O I
10.1103/PhysRevE.70.031911
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
Simulation and theoretical results show that memoryless threshold neurons benefit from small amounts of almost all types of additive noise and so produce the stochastic-resonance or SR effect. Input-output mutual information measures the performance of such threshold systems that use subthreshold signals. The SR result holds for all possible noise probability density functions with finite variance. The only constraint is that the noise mean must fall outside a "forbidden" threshold-related interval that the user can control-a new theorem shows that this condition is also necessary. A corollary and simulations show that the SR effect occurs for right-sided beta and Weibull noise as well. These SR results further hold for the entire uncountably infinite class of alpha-stable probability density functions. Alpha-stable noise densities have infinite variance and infinite higher-order moments and often model impulsive noise environments. The stable noise densities include the special case of symmetric bell-curve densities with thick tails such as the Cauchy probability density. The SR result for alpha-stable noise densities shows that the SR effect in threshold and thresholdlike systems is robust against occasional or even frequent violent fluctuations in noise. Regression analysis reveals both an exponential relationship for the optimal noise dispersion as a function of the alpha bell-curve tail thickness and an approximate linear relationship for the SR-maximal mutual information as a function of the alpha bell-curve tail thickness.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Stochastic resonance in noisy threshold neurons
    Kosko, B
    Mitaim, S
    NEURAL NETWORKS, 2003, 16 (5-6) : 755 - 761
  • [2] Robust neural networks using stochastic resonance neurons
    Egor Manuylovich
    Diego Argüello Ron
    Morteza Kamalian-Kopae
    Sergei K. Turitsyn
    Communications Engineering, 3 (1):
  • [3] Stochastic resonance in an array of integrate-and-fire neurons with threshold
    Zhou, Bingchang
    Qi, Qianqian
    MODERN PHYSICS LETTERS B, 2018, 32 (16):
  • [4] Stochastic resonance and self-tuning: A simple threshold system
    Kondo, Takeo
    Munakata, Toyonori
    PHYSICAL REVIEW E, 2009, 79 (06):
  • [5] Adaptive stochastic resonance for noisy threshold neurons used on mutual information
    Mitaim, S
    Kosko, B
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1980 - 1985
  • [6] Stochastic Resonance in a Simple Threshold Sensor System with Alpha Stable Noise
    张志瑞
    康艳梅
    谢勇
    Communications in Theoretical Physics, 2014, 61 (05) : 578 - 582
  • [7] Stochastic Resonance in a Simple Threshold Sensor System with Alpha Stable Noise
    Zhang Zhi-Rui
    Kang Yan-Mei
    Xie Yong
    COMMUNICATIONS IN THEORETICAL PHYSICS, 2014, 61 (05) : 578 - 582
  • [8] STOCHASTIC RESONANCE IN THRESHOLD DEVICES
    JUNG, P
    MAYERKRESS, G
    NUOVO CIMENTO DELLA SOCIETA ITALIANA DI FISICA D-CONDENSED MATTER ATOMIC MOLECULAR AND CHEMICAL PHYSICS FLUIDS PLASMAS BIOPHYSICS, 1995, 17 (7-8): : 827 - 834
  • [9] Stochastic resonance in threshold systems
    Alibegov, MM
    PHYSICAL REVIEW E, 1999, 59 (05): : 4841 - 4846
  • [10] Waveguide with double threshold resonance at a simple threshold
    Nazarov, S. A.
    SBORNIK MATHEMATICS, 2020, 211 (08) : 1080 - 1126