Approximate Learning Algorithm for Restricted Boltzmann Machines

被引:5
|
作者
Yasuda, Muneki [1 ]
Tanaka, Kazuyuki [1 ]
机构
[1] Tohoku Univ, Grad Sch Informat Sci, Aoba Ku, Sendai, Miyagi 9808579, Japan
关键词
D O I
10.1109/CIMCA.2008.57
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A restricted Boltzmann machine consists of a layer of visible units and a layer of hidden units with no visible-visible or hidden-hidden connections. The restricted Boltzmann machine is the main component used in building up the deep belief network and has been studied by many researchers. However, the learning algorithm for the restricted Boltzmann machine is a NP-hard problem in general. In this paper we propose a new approximate learning algorithm for the restricted Boltzmann machines using the EM algorithm and the loopy belief propagation.
引用
收藏
页码:692 / 697
页数:6
相关论文
共 50 条
  • [21] Learning algorithm in restricted Boltzmann machines using Kullback-Leibler importance estimation procedure
    Yasuda, Muneki
    Sakurai, Tetsuharu
    Tanaka, Kazuyuki
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2011, 2 (02): : 153 - 164
  • [22] Analysis on Noisy Boltzmann Machines and Noisy Restricted Boltzmann Machines
    Lu, Wenhao
    Leung, Chi-Sing
    Sum, John
    IEEE ACCESS, 2021, 9 : 112955 - 112965
  • [23] Relational Restricted Boltzmann Machines: A Probabilistic Logic Learning Approach
    Kaur, Navdeep
    Kunapuli, Gautam
    Khot, Tushar
    Kersting, Kristian
    Cohen, William
    Natarajan, Sriraam
    INDUCTIVE LOGIC PROGRAMMING (ILP 2017), 2018, 10759 : 94 - 111
  • [24] Improved Learning of Gaussian-Bernoulli Restricted Boltzmann Machines
    Cho, KyungHyun
    Ilin, Alexander
    Raiko, Tapani
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2011, PT I, 2011, 6791 : 10 - 17
  • [25] Non-parametric learning of lifted Restricted Boltzmann Machines
    Kaur, Navdeep
    Kunapuli, Gautam
    Natarajan, Sriraam
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2020, 120 : 33 - 47
  • [26] Mode-assisted unsupervised learning of restricted Boltzmann machines
    Manukian, Haik
    Pei, Yan Ru
    Bearden, Sean R. B.
    Di Ventra, Massimiliano
    COMMUNICATIONS PHYSICS, 2020, 3 (01)
  • [27] Mode-assisted unsupervised learning of restricted Boltzmann machines
    Haik Manukian
    Yan Ru Pei
    Sean R. B. Bearden
    Massimiliano Di Ventra
    Communications Physics, 3
  • [28] Convolutional restricted Boltzmann machines learning for robust visual tracking
    Lei, Jun
    Li, GuoHui
    Tu, Dan
    Guo, Qiang
    NEURAL COMPUTING & APPLICATIONS, 2014, 25 (06): : 1383 - 1391
  • [29] Learning Large Q-Matrix by Restricted Boltzmann Machines
    Chengcheng Li
    Chenchen Ma
    Gongjun Xu
    Psychometrika, 2022, 87 : 1010 - 1041
  • [30] Deterministic and Generalized Framework for Unsupervised Learning with Restricted Boltzmann Machines
    Tramel, Eric W.
    Gabrie, Marylou
    Manoel, Andre
    Caltagirone, Francesco
    Krzakala, Florent
    PHYSICAL REVIEW X, 2018, 8 (04):