Unsupervised learning of perceptual feature combinations

被引:0
|
作者
Tamosiunaite, Minija [1 ,2 ]
Tetzlaff, Christian [3 ,4 ]
Woergoetter, Florentin [1 ]
机构
[1] Univ Gottingen, Phys Inst 3, Dept Computat Neurosci, Gottingen, Germany
[2] Vytautas Magnus Univ, Fac Informat, Kaunas, Lithuania
[3] Univ Med Ctr Gottingen, Dept Neuro & Sensory Physiol, Computat Synapt Physiol, Gottingen, Germany
[4] Campus Inst Data Sci, Gottingen, Germany
基金
欧盟地平线“2020”;
关键词
LONG-TERM POTENTIATION; SYNAPTIC PLASTICITY; INDUCTION; NEURONS; ACTIVATION; SIGNALS; MODEL;
D O I
10.1371/journal.pcbi.1011926
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
In many situations it is behaviorally relevant for an animal to respond to co-occurrences of perceptual, possibly polymodal features, while these features alone may have no importance. Thus, it is crucial for animals to learn such feature combinations in spite of the fact that they may occur with variable intensity and occurrence frequency. Here, we present a novel unsupervised learning mechanism that is largely independent of these contingencies and allows neurons in a network to achieve specificity for different feature combinations. This is achieved by a novel correlation-based (Hebbian) learning rule, which allows for linear weight growth and which is combined with a mechanism for gradually reducing the learning rate as soon as the neuron's response becomes feature combination specific. In a set of control experiments, we show that other existing advanced learning rules cannot satisfactorily form ordered multi-feature representations. In addition, we show that networks, which use this type of learning always stabilize and converge to subsets of neurons with different feature-combination specificity. Neurons with this property may, thus, serve as an initial stage for the processing of ecologically relevant real world situations for an animal. During foraging and exploration, the neural system of animals is flooded with numerous sensory features. From this confusing signal repertoire, it needs to learn extracting relevant events often encoded by specific perceptual feature combinations. For example, a specific smell and some distinct visual attribute may be meaningful when occurring together, while by themselves these features are irrelevant. Learning this is complicated by the fact sensory signals occur with different intensity and occurrence frequency beyond the control by the animal. Here we show that it is possible to train neurons with external signals in an unsupervised way to learn responding specifically to different feature combinations largely unaffected by such presentation contingencies. This is achieved by a novel learning rule which achieves stable neuronal responses in a simple way by gradually reducing the learning rate at its synapses as soon as the neuron's response to the feature combination exceeds a certain level. This allows neurons in a network to code for different feature combinations and may facilitate ecologically meaningful evaluation of perceived situations by the animal.
引用
收藏
页数:27
相关论文
共 50 条
  • [1] Unsupervised learning of PNPPword combinations
    Galicia-Haro, SN
    Gelbukh, A
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2005, 3406 : 337 - 340
  • [2] Perceptual learning, roving and the unsupervised bias
    Herzog, Michael H.
    Aberg, Kristoffer C.
    Fremaux, Nicolas
    Gerstner, Wulfram
    Sprekeler, Henning
    VISION RESEARCH, 2012, 61 : 95 - 99
  • [3] Modeling Unsupervised Perceptual Category Learning
    Lake, Brenden M.
    Vallabha, Gautam K.
    McClelland, James L.
    2008 IEEE 7TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, 2008, : 25 - 30
  • [4] Perceptual learning, roving and the unsupervised bias
    Clarke, A.
    Sprekeler, H.
    Gerstner, W.
    Herzog, M.
    PERCEPTION, 2011, 40 : 50 - 50
  • [5] Modeling Unsupervised Perceptual Category Learning
    Lake, Brenden M.
    Vallabha, Gautam K.
    McClelland, James L.
    IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2009, 1 (01) : 35 - 43
  • [6] Unsupervised Perceptual Rewards for Imitation Learning
    Sermanet, Pierre
    Xu, Kelvin
    Levine, Sergey
    ROBOTICS: SCIENCE AND SYSTEMS XIII, 2017,
  • [7] Feature selection for unsupervised learning
    Dy, JG
    Brodley, CE
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 845 - 889
  • [8] Feature Selection for Unsupervised Learning
    Adhikary, Jyoti Ranjan
    Murty, M. Narasimha
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 382 - 389
  • [9] Unsupervised repetition enables rapid perceptual learning
    Montazeri, Vahid
    Kapolowicz, Michelle R.
    Assmann, Peter F.
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2021, 150 (05): : 3964 - 3975
  • [10] Active Learning with Clustering and Unsupervised Feature Learning
    Berardo, Saul
    Favero, Eloi
    Neto, Nelson
    ADVANCES IN ARTIFICIAL INTELLIGENCE (AI 2015), 2015, 9091 : 281 - 290