PIMBALL Binary Neural Networks in Spintronic Memory

被引:23
|
作者
Resch, Salonik [1 ]
Khatamifard, S. Karen [1 ]
Chowdhury, Zamshed Iqbal [1 ]
Zabihi, Masoud [1 ]
Zhao, Zhengyang [1 ]
Wang, Jian-Ping [1 ]
Sapatnekar, Sachin S. [1 ]
Karpuzcu, Ulya R. [1 ]
机构
[1] Univ Minnesota Twin Cities, 200 Union St SE, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
Processing in memory; non-volatile memory; binary neural networks; computational random access memory;
D O I
10.1145/3357250
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural networks span a wide range of applications of industrial and commercial significance. Binary neural networks (BNN) are particularly effective in trading accuracy for performance, energy efficiency, or hardware/software complexity. Here, we introduce a spintronic, re-configurable in-memory BNN accelerator, PIMBALL: Processing In Memory BNN AcceL(L)erator, which allows for massively parallel and energy efficient computation. PIMBALL is capable of being used as a standard spintronic memory (STT-MRAM) array and a computational substrate simultaneously. We evaluate PIMBALL using multiple image classifiers and a genomics kernel. Our simulation results show that PIMBALL is more energy efficient than alternative CPU-, GPU-, and FPGA-based implementations while delivering higher throughput.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Nonvolatile Spintronic Memory Cells for Neural Networks
    Stephan, Andrew W.
    Lou, Qiuwen
    Niemier, Michael T.
    Hu, Xiaobo Sharon
    Koester, Steven J.
    IEEE JOURNAL ON EXPLORATORY SOLID-STATE COMPUTATIONAL DEVICES AND CIRCUITS, 2019, 5 (02): : 67 - 73
  • [2] A survey of spintronic architectures for processing-in-memory and neural networks
    Umesh, Sumanth
    Mittal, Sparsh
    JOURNAL OF SYSTEMS ARCHITECTURE, 2019, 97 (349-372) : 349 - 372
  • [3] SpinDrop: Dropout-Based Bayesian Binary Neural Networks With Spintronic Implementation
    Ahmed, Soyed Tuhin
    Danouchi, Kamal
    Munch, Christopher
    Prenat, Guillaume
    Anghel, Lorena
    Tahoori, Mehdi B.
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2023, 13 (01) : 150 - 164
  • [4] Spintronic Computing-in-Memory Architecture Based on Voltage-Controlled Spin-Orbit Torque Devices for Binary Neural Networks
    Wang, Haotian
    Kang, Wang
    Pan, Biao
    Zhang, He
    Deng, Erya
    Zhao, Weisheng
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2021, 68 (10) : 4944 - 4950
  • [5] Memory Efficient Binary Convolutional Neural Networks on Microcontrollers
    Sakr, Fouad
    Berta, Riccardo
    Doyle, Joseph
    Younes, Hamoud
    De Gloria, Alessandro
    Bellotti, Francesco
    2022 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS (IEEE EDGE 2022), 2022, : 169 - 177
  • [6] Binary Bayesian Neural Networks for Efficient Uncertainty Estimation Leveraging Inherent Stochasticity of Spintronic Devices
    Ahmed, Soyed Tuhin
    Danouchi, Kamal
    Muench, Christopher
    Prenat, Guillaume
    Anghel, Lorena
    Tahoori, Mehdi B.
    PROCEEDINGS OF THE 17TH ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES, NANOARCH 2022, 2022,
  • [7] Spiking Neural Networks in Spintronic Computational RAM
    Cilasun, Husrev
    Resch, Salonik
    Chowdhury, Zamshed, I
    Olson, Erin
    Zabihi, Masoud
    Zhao, Zhengyang
    Peterson, Thomas
    Parhi, Keshab K.
    Wang, Jian-Ping
    Sapatnekar, Sachin S.
    Karpuzcu, Ulya R.
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (04)
  • [8] Multilayer spintronic neural networks with radiofrequency connections
    Andrew Ross
    Nathan Leroux
    Arnaud De Riz
    Danijela Marković
    Dédalo Sanz-Hernández
    Juan Trastoy
    Paolo Bortolotti
    Damien Querlioz
    Leandro Martins
    Luana Benetti
    Marcel S. Claro
    Pedro Anacleto
    Alejandro Schulman
    Thierry Taris
    Jean-Baptiste Begueret
    Sylvain Saïghi
    Alex S. Jenkins
    Ricardo Ferreira
    Adrien F. Vincent
    Frank Alice Mizrahi
    Julie Grollier
    Nature Nanotechnology, 2023, 18 : 1273 - 1280
  • [9] Multilayer spintronic neural networks with radiofrequency connections
    Ross, Andrew
    Leroux, Nathan
    De Riz, Arnaud
    Markovic, Danijela
    Sanz-Hernandez, Dedalo
    Trastoy, Juan
    Bortolotti, Paolo
    Querlioz, Damien
    Martins, Leandro
    Benetti, Luana
    Claro, Marcel S.
    Anacleto, Pedro
    Schulman, Alejandro
    Taris, Thierry
    Begueret, Jean-Baptiste
    Saighi, Sylvain
    Jenkins, Alex S.
    Ferreira, Ricardo
    Vincent, Adrien F.
    Mizrahi, Frank Alice
    Grollier, Julie
    NATURE NANOTECHNOLOGY, 2023, 18 (11) : 1273 - +
  • [10] Reliability of Neural Networks Based on Spintronic Neurons
    Raimondo, Eleonora
    Giordano, Anna
    Grimaldi, Andrea
    Puliafito, Vito
    Carpentieri, Mario
    Zeng, Zhongming
    Tomasello, Riccardo
    Finocchio, Giovanni
    IEEE MAGNETICS LETTERS, 2021, 12