Learning representations in Bayesian Confidence Propagation neural networks

被引:7
|
作者
Ravichandran, Naresh Balaji [1 ]
Lansner, Anders [2 ,3 ]
Herman, Pawel [1 ]
机构
[1] KTH Royal Inst Technol, Computat Brain Sci Lab, Stockholm, Sweden
[2] Stockholm Univ, Computat Brain Sci Lab, Stockholm, Sweden
[3] KTH Royal Inst Technol, Stockholm, Sweden
关键词
neural networks; brain-like computing; bio-inspired; unsupervised learning; structural plasticity; ATTRACTOR NETWORK; MODEL;
D O I
10.1109/ijcnn48605.2020.9207061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised learning of hierarchical representations has been one of the most vibrant research directions in deep learning during recent years. In this work we study biologically inspired unsupervised strategies in neural networks based on local Hebbian learning. We propose new mechanisms to extend the Bayesian Confidence Propagating Neural Network (BCPNN) architecture, and demonstrate their capability for unsupervised learning of salient hidden representations when tested on the MNIST dataset.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] Learning Word Representations with Deep Neural Networks for Turkish
    Dundar, Enes Burak
    Alpaydin, Ethem
    2019 27TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2019,
  • [32] Confidence bounds for neural network representations
    Shao, R
    Martin, EB
    Zhang, J
    Morris, AJ
    COMPUTERS & CHEMICAL ENGINEERING, 1997, 21 : S1173 - S1178
  • [33] Confidence bounds for neural network representations
    Shao, Rui
    Martin, E.B.
    Zhang, J.
    Morris, A. Julian
    Computers and Chemical Engineering, 1997, 21 (SUPPL. 1):
  • [34] Pixel-wise confidence estimation for segmentation in Bayesian Convolutional Neural Networks
    Martin, Remi
    Duong, Luc
    MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [35] Pixel-wise confidence estimation for segmentation in Bayesian Convolutional Neural Networks
    Rémi Martin
    Luc Duong
    Machine Vision and Applications, 2023, 34
  • [36] Learning Bayesian belief networks with neural network estimators
    Monti, S
    Cooper, GF
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 578 - 584
  • [37] A hierarchical Bayesian learning scheme for autoregressive neural networks
    Acernese, F
    Barone, F
    De Rosa, R
    Eleuteri, A
    Milano, L
    Tagliaferri, R
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 1356 - 1360
  • [38] Learning Structured Weight Uncertainty in Bayesian Neural Networks
    Sun, Shengyang
    Chen, Changyou
    Carin, Lawrence
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 1283 - 1292
  • [39] Learning Global Pairwise Interactions with Bayesian Neural Networks
    Cui, Tianyu
    Marttinen, Pekka
    Kaski, Samuel
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1087 - 1094
  • [40] Hierarchical Bayesian Inference and Learning in Spiking Neural Networks
    Guo, Shangqi
    Yu, Zhaofei
    Deng, Fei
    Hu, Xiaolin
    Chen, Feng
    IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (01) : 133 - 145