Leveraging Stochasticity for In Situ Learning in Binarized Deep Neural Networks

被引:2
|
作者
Pyle, Steven D. [1 ]
Sapp, Justin D. [1 ]
DeMara, Ronald F. [2 ]
机构
[1] Univ Cent Florida, Comp Engn, Orlando, FL 32816 USA
[2] Univ Cent Florida, Dept Elect & Comp Engn, Orlando, FL 32816 USA
基金
美国国家科学基金会;
关键词
461.4 Ergonomics and Human Factors Engineering - 731.1 Control Systems - 961 Systems Science;
D O I
10.1109/MC.2019.2906133
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
A recent thrust in deep neural network (DNN) research has been toward binary approaches for compact and energy-sparing neuromorphic architectures utilizing emerging devices. However, approaches to deal with device process variations and the realization of stochastic behavior intrinsically within neural circuits remain underexplored. Herein, we leverage a novel probabilistic spintronic device for low-energy recognition operations that improves DNN performance through active in situ learning via the mitigation of device reliability challenges.
引用
收藏
页码:30 / 39
页数:10
相关论文
共 50 条
  • [1] Formal Analysis of Deep Binarized Neural Networks
    Narodytska, Nina
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 5692 - 5696
  • [2] Verifying Properties of Binarized Deep Neural Networks
    Narodytska, Nina
    Kasiviswanathan, Shiva
    Ryzhyk, Leonid
    Sagiv, Mooly
    Walsh, Toby
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 6615 - 6624
  • [3] Towards Stochasticity of Regularization in Deep Neural Networks
    Sandjakoska, Ljubinka
    Bogdanova, Ana Madevska
    2018 14TH SYMPOSIUM ON NEURAL NETWORKS AND APPLICATIONS (NEUREL), 2018,
  • [4] Binarized Neural Networks
    Hubara, Itay
    Courbariaux, Matthieu
    Soudry, Daniel
    El-Yaniv, Ran
    Bengio, Yoshua
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [5] Fast Simulation Method for Analog Deep Binarized Neural Networks
    Lee, Chaeun
    Kim, Jaehyun
    Kim, Jihun
    Hwang, Cheol Seong
    Choi, Kiyoung
    2019 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2019, : 293 - 294
  • [6] LightNN: Filling the Gap between Conventional Deep Neural Networks and Binarized Networks
    Ding, Ruizhou
    Liu, Zeye
    Shi, Rongye
    Marculescu, Diana
    Blanton, R. D.
    PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2017 (GLSVLSI' 17), 2017, : 35 - 40
  • [7] Memristor Binarized Neural Networks
    Khoa Van Pham
    Tien Van Nguyen
    Son Bao Tran
    Nam, Hyunkyung
    Lee, Mi Jung
    Choi, Byung Joon
    Son Ngoc Truong
    Min, Kyeong-Sik
    JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, 2018, 18 (05) : 568 - 577
  • [8] Verifying Binarized Neural Networks by Angluin-Style Learning
    Shih, Andy
    Darwiche, Adnan
    Choi, Arthur
    THEORY AND APPLICATIONS OF SATISFIABILITY TESTING - SAT 2019, 2019, 11628 : 354 - 370
  • [9] A Review of Binarized Neural Networks
    Simons, Taylor
    Lee, Dah-Jye
    ELECTRONICS, 2019, 8 (06)
  • [10] Leveraging deep learning to control neural oscillators
    Timothy D. Matchen
    Jeff Moehlis
    Biological Cybernetics, 2021, 115 : 219 - 235