Minimising Contrastive Divergence with Dynamic Current Mirrors

被引:0
|
作者
Lu, Chih-Cheng [1 ]
Chen, H. [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Minimising Contrastive Divergence; Dynamic Current Mirrors; Probabilistic Model; Boltzmann Machine; On-chip training; MACHINE; NOISE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Implementing probabilistic models in Very-Large-Scale-Integration (VLSI) has been attractive to implantable biomedical devices for improving sensor fusion. However, hardware non-idealities can introduce training errors, hindering optimal modelling through on-chip adaptation. This paper investigates the feasibility of using the dynamic current mirrors to implement a simple and precise training circuit. The precision required for training the Continuous Restricted Boltzmann Machine (CRBM) is first identified. A training circuit based on accumulators formed by dynamic current mirrors is then proposed. By measuring the accumulators in VLSI, the feasibility of training the CRBM on chip according to its minimizing-contrastive-divergence rule is concluded.
引用
收藏
页码:410 / 420
页数:11
相关论文
共 50 条
  • [1] Minimising contrastive divergence in noisy, mixed-mode VLSI neurons
    Chen, H
    Fleury, P
    Murray, AF
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 16, 2004, 16 : 1011 - 1018
  • [2] VERY ACCURATE DYNAMIC CURRENT MIRRORS
    WEGMANN, G
    VITTOZ, EA
    ELECTRONICS LETTERS, 1989, 25 (10) : 644 - 646
  • [3] Weighted contrastive divergence
    Romero, Enrique
    Mazzanti, Ferran
    Delgado, Jordi
    Buchaca, David
    NEURAL NETWORKS, 2019, 114 : 147 - 156
  • [5] BASIC PRINCIPLES OF ACCURATE DYNAMIC CURRENT MIRRORS
    WEGMANN, G
    VITTOZ, EA
    IEE PROCEEDINGS-G CIRCUITS DEVICES AND SYSTEMS, 1990, 137 (02): : 95 - 100
  • [6] Current mirrors with limiting of linear dynamic range
    Filanovsky, IM
    2002 45TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II, CONFERENCE PROCEEDINGS, 2002, : 61 - 64
  • [7] ANALYSIS AND IMPROVEMENTS OF ACCURATE DYNAMIC CURRENT MIRRORS
    WEGMANN, G
    VITTOZ, EA
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1990, 25 (03) : 699 - 706
  • [8] Justifying and Generalizing Contrastive Divergence
    Bengio, Yoshua
    Delalleau, Olivier
    NEURAL COMPUTATION, 2009, 21 (06) : 1601 - 1621
  • [9] Wormholes improve contrastive divergence
    Hinton, G
    Welling, M
    Mnih, A
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 16, 2004, 16 : 417 - 424
  • [10] Contrastive divergence in Gaussian diffusions
    Movellan, Javier R.
    NEURAL COMPUTATION, 2008, 20 (09) : 2238 - 2252