Implementation of Artificial Neural Networks Using Magnetoresistive Random-Access Memory-Based Stochastic Computing Units

被引:16
|
作者
Shao, Yixin [1 ]
Sinaga, Sisilia Lamsari [1 ]
Sunmola, Idris O. [1 ]
Borland, Andrew S. [1 ]
Carey, Matthew J. [2 ]
Katine, Jordan A. [2 ]
Lopez-Dominguez, Victor [1 ]
Amiri, Pedram Khalili [1 ]
机构
[1] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
[2] Western Digital Corp, San Jose, CA 95119 USA
基金
美国国家科学基金会;
关键词
Magnetic tunneling; Voltage measurement; Electrical resistance measurement; Resistance; Hardware; Magnetic field measurement; Logic gates; Spin electronics; artificial neural network; magnetoresistive random-access memory; stochastic computing; TUNNEL MAGNETORESISTANCE; ROOM-TEMPERATURE; EFFICIENT; JUNCTIONS;
D O I
10.1109/LMAG.2021.3071084
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hardware implementation of artificial neural networks (ANNs) using conventional binary arithmetic units requires large area and energy, due to the massive multiplication and addition operations in the inference process, limiting their use in edge computing and emerging Internet of Things (IoT) systems. Stochastic computing (SC), where the probability of 1s and 0s in a randomly generated bit-stream is used to represent a decimal number, has been devised as an alternative for compact and low-energy arithmetic hardware, due to its ability to implement basic arithmetic operations using far fewer logic gates than binary operations. To realize SC in hardware, however, tunable true random-number generators (TRNGs) are needed, which cannot be efficiently realized using existing complementary metal-oxide-semiconductor complementary metal-oxide-semiconductor (CMOS) technology. In this letter, we address this challenge by using magnetic tunnel junctions (MTJs) as TRNGs, the stochasticity of which can be tuned by an electric current via spin-transfer torque. We demonstrate the implementation of ANNs with SC units, using stochastic bit-streams experimentally generated by a series of 50 nm perpendicular MTJs. The numerical value (1 to 0 ratio) of the bit-streams is tuned by the current through the MTJs via spin-transfer torque with an ultralow current of <5 mu A (= 0.25 MA.cm(-2)). The MTJ-based SC-ANN achieves 95% accuracy for handwritten digit recognition on the MNIST database. MRAM-based SC-ANNs provide a promising solution for ultra-low-power machine learning in edge, mobile, and IoT devices.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] In situ Parallel Training of Analog Neural Network Using Electrochemical Random-Access Memory
    Li, Yiyang
    Xiao, T. Patrick
    Bennett, Christopher H.
    Isele, Erik
    Melianas, Armantas
    Tao, Hanbo
    Marinella, Matthew J.
    Salleo, Alberto
    Fuller, Elliot J.
    Talin, A. Alec
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [22] An Efficient Hardware Implementation of Artificial Neural Network based on Stochastic Computing
    Duy-Anh Nguyen
    Huy-Hung Ho
    Duy-Hieu Bui
    Xuan-Tu Tran
    PROCEEDINGS OF 2018 5TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS 2018), 2018, : 237 - 242
  • [23] Synapse-Mimetic Hardware-Implemented Resistive Random-Access Memory for Artificial Neural Network
    Seok, Hyunho
    Son, Shihoon
    Jathar, Sagar Bhaurao
    Lee, Jaewon
    Kim, Taesung
    SENSORS, 2023, 23 (06)
  • [24] Fully Binarized Graph Convolutional Network Accelerator Based on In-Memory Computing with Resistive Random-Access Memory
    Zhang, Woyu
    Li, Zhi
    Zhang, Xinyuan
    Wang, Fei
    Wang, Shaocong
    Lin, Ning
    Li, Yi
    Wang, Jun
    Yue, Jinshan
    Dou, Chunmeng
    Xu, Xiaoxin
    Wang, Zhongrui
    Shang, Dashan
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (07)
  • [25] VLSI Implementation of Deep Neural Networks Using Integral Stochastic Computing
    Ardakani, Arash
    Leduc-Primeau, Fracois
    Onizawa, Naoya
    Hanyu, Takahiro
    Gross, Warren J.
    2016 9TH INTERNATIONAL SYMPOSIUM ON TURBO CODES AND ITERATIVE INFORMATION PROCESSING (ISTC), 2016, : 216 - 220
  • [26] FangTianSim: High-Level Cycle-Accurate Resistive Random-Access Memory-Based Multi-Core Spiking Neural Network Processor Simulator
    Wei, Jinsong
    Wang, Zhibin
    Li, Ye
    Lu, Jikai
    Jiang, Hao
    An, Junjie
    Li, Yiqi
    Gao, Lili
    Zhang, Xumeng
    Shi, Tuo
    Liu, Qi
    FRONTIERS IN NEUROSCIENCE, 2022, 15
  • [27] Digital Implementation of Radial Basis Function Neural Networks Based on Stochastic Computing
    Moran, Alejandro
    Parrilla, Luis
    Roca, Miquel
    Font-Rossello, Joan
    Isern, Eugeni
    Canals, Vincent
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2023, 13 (01) : 257 - 269
  • [28] Artificial Synaptic Properties in Oxygen-Based Electrochemical Random-Access Memory with CeO2 Nanoparticle Assembly as Gate Insulator for Neuromorphic Computing
    Jeong, Boyoung
    Noh, Taeyun
    Han, Jimin
    Ryu, Jiyeon
    Park, Jae-Gwan
    Kim, Younguk
    Choi, Yonghoon
    Lee, Sehyun
    Park, Jongnam
    Yoon, Tae-Sik
    ACS APPLIED MATERIALS & INTERFACES, 2025, 17 (11) : 17105 - 17116
  • [29] Impact of Spin-Transfer Torque on the Write-Error Rate of a Voltage-Torque-Based Magnetoresistive Random-Access Memory
    Imamura, Hiroshi
    Matsumoto, Rie
    PHYSICAL REVIEW APPLIED, 2019, 11 (06)
  • [30] An Efficient Hardware Implementation of Activation Functions Using Stochastic Computing for Deep Neural Networks
    Van-Tinh Nguyen
    Tieu-Khanh Luong
    Han Le Duc
    Van-Phuc Hoang
    2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2018), 2018, : 233 - 236