Learning representations in Bayesian Confidence Propagation neural networks

被引：7

作者：

Ravichandran, Naresh Balaji ^{[1
]}

Lansner, Anders ^{[2
,3
]}

Herman, Pawel ^{[1
]}

机构：

[1] KTH Royal Inst Technol, Computat Brain Sci Lab, Stockholm, Sweden

[2] Stockholm Univ, Computat Brain Sci Lab, Stockholm, Sweden

[3] KTH Royal Inst Technol, Stockholm, Sweden

来源：

2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2020年

关键词：

neural networks; brain-like computing; bio-inspired; unsupervised learning; structural plasticity; ATTRACTOR NETWORK; MODEL;

D O I：

10.1109/ijcnn48605.2020.9207061

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Unsupervised learning of hierarchical representations has been one of the most vibrant research directions in deep learning during recent years. In this work we study biologically inspired unsupervised strategies in neural networks based on local Hebbian learning. We propose new mechanisms to extend the Bayesian Confidence Propagating Neural Network (BCPNN) architecture, and demonstrate their capability for unsupervised learning of salient hidden representations when tested on the MNIST dataset.

引用

页数：7

共 50 条

[21] Probabilistic inference of Bayesian neural networks with generalized expectation propagation
Zhao, Jing
Liu, Xiao
He, Shaojie
Sun, Shiliang
NEUROCOMPUTING, 2020, 412 (412) : 392 - 398
[22] Uncertainty propagation for dropout-based Bayesian neural networks
Mae, Yuki
Kumagai, Wataru
Kanamori, Takafumi
NEURAL NETWORKS, 2021, 144 : 394 - 406
[23] A Scalable Custom Simulation Machine for the Bayesian Confidence Propagation Neural Network model of the Brain
Farahini, Nasim
Hemani, Ahmed
Lansner, Anders
Clermidy, Fabian
Svensson, Christer
2014 19TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2014, : 578 - 585
[24] Variational Learning of Bayesian Neural Networks via Bayesian Dark Knowledge
Shen, Gehui
Chen, Xi
Deng, Zhihong
PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2037 - 2043
[25] Learning of Process Representations Using Recurrent Neural Networks
Seeliger, Alexander
Luettgen, Stefan
Nolle, Timo
Muehlhaeuser, Max
ADVANCED INFORMATION SYSTEMS ENGINEERING (CAISE 2021), 2021, 12751 : 109 - 124
[26] A NEW ALGORITHM FOR LEARNING REPRESENTATIONS IN BOOLEAN NEURAL NETWORKS
BISWAS, NN
KUMAR, R
CURRENT SCIENCE, 1990, 59 (12): : 595 - 600
[27] Rep the Set: Neural Networks for Learning Set Representations
Skianis, Konstantinos
Nikolentzos, Giannis
Limnios, Stratis
Vazirgiannis, Michalis
INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108
[28] Learning Transferable Feature Representations Using Neural Networks
Bhatt, Himanshu S.
Roy, Shourya
Rajkumar, Arun
Ramakrishnan, Sriranjani
57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 4124 - 4134
[29] Residual Recurrent Neural Networks for Learning Sequential Representations
Yue, Boxuan
Fu, Junwei
Liang, Jun
INFORMATION, 2018, 9 (03)
[30] Learning Reliable Neural Networks with Distributed Architecture Representations
Li, Yinqiao
Cao, Runzhe
He, Qiaozhi
Xiao, Tong
Zhu, Jingbo
ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (04)

← 1 2 3 4 5 →