Leveraging Stochasticity for In Situ Learning in Binarized Deep Neural Networks

被引:2
|
作者
Pyle, Steven D. [1 ]
Sapp, Justin D. [1 ]
DeMara, Ronald F. [2 ]
机构
[1] Univ Cent Florida, Comp Engn, Orlando, FL 32816 USA
[2] Univ Cent Florida, Dept Elect & Comp Engn, Orlando, FL 32816 USA
基金
美国国家科学基金会;
关键词
461.4 Ergonomics and Human Factors Engineering - 731.1 Control Systems - 961 Systems Science;
D O I
10.1109/MC.2019.2906133
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
A recent thrust in deep neural network (DNN) research has been toward binary approaches for compact and energy-sparing neuromorphic architectures utilizing emerging devices. However, approaches to deal with device process variations and the realization of stochastic behavior intrinsically within neural circuits remain underexplored. Herein, we leverage a novel probabilistic spintronic device for low-energy recognition operations that improves DNN performance through active in situ learning via the mitigation of device reliability challenges.
引用
收藏
页码:30 / 39
页数:10
相关论文
共 50 条
  • [31] Improving generalization of deep neural networks by leveraging margin distribution
    Lyu, Shen-Huan
    Wang, Lu
    Zhou, Zhi-Hua
    NEURAL NETWORKS, 2022, 151 : 48 - 60
  • [32] Leveraging Deep Neural Networks for Massive MIMO Data Detection
    Nguyen, Ly V.
    Nguyen, Nhan T.
    Tran, Nghi H.
    Juntti, Markku
    Swindlehurst, A. Lee
    Nguyen, Duy H. N.
    IEEE WIRELESS COMMUNICATIONS, 2023, 30 (01) : 174 - 180
  • [33] Leveraging the Bhattacharyya coefficient for uncertainty quantification in deep neural networks
    Pieter Van Molle
    Tim Verbelen
    Bert Vankeirsbilck
    Jonas De Vylder
    Bart Diricx
    Tom Kimpe
    Pieter Simoens
    Bart Dhoedt
    Neural Computing and Applications, 2021, 33 : 10259 - 10275
  • [34] Online Deep Learning: Learning Deep Neural Networks on the Fly
    Sahoo, Doyen
    Pham, Quang
    Lu, Jing
    Hoi, Steven C. H.
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2660 - 2666
  • [35] ReBNN: in-situ acceleration of binarized neural networks in ReRAM using complementary resistive cell
    Song, Linghao
    Wu, You
    Qian, Xuehai
    Li, Hai
    Chen, Yiran
    CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING, 2019, 1 (3-4) : 196 - 208
  • [36] ReBNN: in-situ acceleration of binarized neural networks in ReRAM using complementary resistive cell
    Linghao Song
    You Wu
    Xuehai Qian
    Hai Li
    Yiran Chen
    CCF Transactions on High Performance Computing, 2019, 1 : 196 - 208
  • [37] Sparsity-Inducing Binarized Neural Networks
    Wang, Peisong
    He, Xiangyu
    Li, Gang
    Zhao, Tianli
    Cheng, Jian
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12192 - 12199
  • [38] Portfolio solver for verifying Binarized Neural Networks
    Kovasznai, Gergely
    Gajdar, Krisztian
    Narodytska, Nina
    ANNALES MATHEMATICAE ET INFORMATICAE, 2021, 53 : 183 - 200
  • [39] Genetic Architecture Search for Binarized Neural Networks
    Chang, Yangyang
    Sobelman, Gerald E.
    Zhou, Xiaofang
    2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2019,
  • [40] BS4NN: Binarized Spiking Neural Networks with Temporal Coding and Learning
    Saeed Reza Kheradpisheh
    Maryam Mirsadeghi
    Timothée Masquelier
    Neural Processing Letters, 2022, 54 : 1255 - 1273