Learning input correlations through nonlinear temporally asymmetric hebbian plasticity

被引:0
|
作者
Gütig, R
Aharonov, R
Rotter, S
Sompolinsky, H [1 ]
机构
[1] Hebrew Univ Jerusalem, Racah Inst Phys, IL-91904 Jerusalem, Israel
[2] Univ Freiburg, Inst Biol 3, D-79104 Freiburg, Germany
[3] Hebrew Univ Jerusalem, Interdisciplinary Ctr Neural Computat, IL-91904 Jerusalem, Israel
来源
JOURNAL OF NEUROSCIENCE | 2003年 / 23卷 / 09期
关键词
Hebbian learning; spike-timing-dependent plasticity; synaptic updating; symmetry breaking; unsupervised learning; infomax; activity-dependent development;
D O I
暂无
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Triggered by recent experimental results, temporally asymmetric Hebbian (TAH) plasticity is considered as a candidate model for the biological implementation of competitive synaptic learning, a key concept for the experience-based development of cortical circuitry. However, because of the well known positive feedback instability of correlation-based plasticity, the stability of the resulting learning process has remained a central problem. Plagued by either a runaway of the synaptic efficacies or a greatly reduced sensitivity to input correlations, the learning performance of current models is limited. Here we introduce a novel generalized nonlinear TAH learning rule that allows a balance between stability and sensitivity of learning. Using this rule, we study the capacity of the system to learn patterns of correlations between afferent spike trains. Specifically, we address the question of under which conditions learning induces spontaneous symmetry breaking and leads to inhomogeneous synaptic distributions that capture the structure of the input correlations. To study the efficiency of learning temporal relationships between afferent spike trains through TAH plasticity, we introduce a novel sensitivity measure that quantifies the amount of information about the correlation structure in the input, a learning rule capable of storing in the synaptic weights. We demonstrate that by adjusting the weight dependence of the synaptic changes in TAH plasticity, it is possible to enhance the synaptic representation of temporal input correlations while maintaining the system in a stable learning regime. Indeed, for a given distribution of inputs, the learning efficiency can be optimized.
引用
收藏
页码:3697 / 3714
页数:18
相关论文
共 50 条
  • [21] Competitive Hebbian learning through spike-timing-dependent synaptic plasticity
    Sen Song
    Kenneth D. Miller
    L. F. Abbott
    Nature Neuroscience, 2000, 3 : 919 - 926
  • [22] Derivation of Linear Hebbian Equations from a Nonlinear Hebbian Model of Synaptic Plasticity
    Miller, Kenneth D.
    NEURAL COMPUTATION, 1990, 2 (03) : 321 - 333
  • [23] Competitive Hebbian learning through spike-timing-dependent synaptic plasticity
    Song, S
    Miller, KD
    Abbott, LF
    NATURE NEUROSCIENCE, 2000, 3 (09) : 919 - 926
  • [24] The temporal paradox of Hebbian learning and homeostatic plasticity
    Zenke, Friedemann
    Gerstner, Wulfram
    Ganguli, Surya
    CURRENT OPINION IN NEUROBIOLOGY, 2017, 43 : 166 - 176
  • [25] Enabling Continual Learning with Differentiable Hebbian Plasticity
    Thangarasa, Vithursan
    Miconi, Thomas
    Taylor, Graham W.
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [26] From modulated Hebbian plasticity to simple behavior learning through noise and weight saturation
    Soltoggio, Andrea
    Stanley, Kenneth O.
    NEURAL NETWORKS, 2012, 34 : 28 - 41
  • [27] Memory-Dependent Computation and Learning in Spiking Neural Networks Through Hebbian Plasticity
    Limbacher, Thomas
    Ozdenizci, Ozan
    Legenstein, Robert
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 12
  • [28] A NONLINEAR EXTENSION OF THE GENERALIZED HEBBIAN LEARNING
    JOUTSENSALO, J
    KARHUNEN, J
    NEURAL PROCESSING LETTERS, 1995, 2 (01) : 5 - 8
  • [29] Deep Learning With Asymmetric Connections and Hebbian Updates
    Amit, Yali
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2019, 13
  • [30] MOS CIRCUIT FOR NONLINEAR HEBBIAN LEARNING
    COHEN, MH
    ANDREOU, AC
    ELECTRONICS LETTERS, 1992, 28 (06) : 591 - 593