Implementation of Artificial Neural Networks Using Magnetoresistive Random-Access Memory-Based Stochastic Computing Units

被引:16
|
作者
Shao, Yixin [1 ]
Sinaga, Sisilia Lamsari [1 ]
Sunmola, Idris O. [1 ]
Borland, Andrew S. [1 ]
Carey, Matthew J. [2 ]
Katine, Jordan A. [2 ]
Lopez-Dominguez, Victor [1 ]
Amiri, Pedram Khalili [1 ]
机构
[1] Northwestern Univ, Dept Elect & Comp Engn, Evanston, IL 60208 USA
[2] Western Digital Corp, San Jose, CA 95119 USA
基金
美国国家科学基金会;
关键词
Magnetic tunneling; Voltage measurement; Electrical resistance measurement; Resistance; Hardware; Magnetic field measurement; Logic gates; Spin electronics; artificial neural network; magnetoresistive random-access memory; stochastic computing; TUNNEL MAGNETORESISTANCE; ROOM-TEMPERATURE; EFFICIENT; JUNCTIONS;
D O I
10.1109/LMAG.2021.3071084
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hardware implementation of artificial neural networks (ANNs) using conventional binary arithmetic units requires large area and energy, due to the massive multiplication and addition operations in the inference process, limiting their use in edge computing and emerging Internet of Things (IoT) systems. Stochastic computing (SC), where the probability of 1s and 0s in a randomly generated bit-stream is used to represent a decimal number, has been devised as an alternative for compact and low-energy arithmetic hardware, due to its ability to implement basic arithmetic operations using far fewer logic gates than binary operations. To realize SC in hardware, however, tunable true random-number generators (TRNGs) are needed, which cannot be efficiently realized using existing complementary metal-oxide-semiconductor complementary metal-oxide-semiconductor (CMOS) technology. In this letter, we address this challenge by using magnetic tunnel junctions (MTJs) as TRNGs, the stochasticity of which can be tuned by an electric current via spin-transfer torque. We demonstrate the implementation of ANNs with SC units, using stochastic bit-streams experimentally generated by a series of 50 nm perpendicular MTJs. The numerical value (1 to 0 ratio) of the bit-streams is tuned by the current through the MTJs via spin-transfer torque with an ultralow current of <5 mu A (= 0.25 MA.cm(-2)). The MTJ-based SC-ANN achieves 95% accuracy for handwritten digit recognition on the MNIST database. MRAM-based SC-ANNs provide a promising solution for ultra-low-power machine learning in edge, mobile, and IoT devices.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Use of Magnetoresistive Random-Access Memory as Approximate Memory for Training Neural Networks
    Locatelli, Nicolas
    Vincent, Adrien F.
    Querlioz, Damien
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2018, : 553 - 556
  • [2] Magnetic Random-Access Memory-Based Approximate Computing: An Overview
    Wang, You
    Zhang, Kaili
    Wu, Bo
    Zhang, Deming
    Zhao, Weisheng
    Cai, Hao
    IEEE NANOTECHNOLOGY MAGAZINE, 2022, 16 (01) : 25 - 32
  • [3] Nonvolatile Magnetoresistive Random-Access Memory Based on Magnetic Tunnel Junctions
    G. Grynkewich
    J. Åkerman
    P. Brown
    B. Butcher
    R. W. Dave
    M. DeHerrera
    M. Durlam
    B. N. Engel
    J. Janesky
    S. Pietambaram
    N. D. Rizzo
    J. M. Slaughter
    K. Smith
    J. J. Sun
    S. Tehrani
    MRS Bulletin, 2004, 29 : 818 - 821
  • [4] Nonvolatile magnetoresistive random-access memory based on magnetic tunnel junctions
    Grynkewich, G
    Åkerman, J
    Brown, R
    Butcher, B
    Dave, RW
    DeHerrera, M
    Durlam, M
    Engel, BN
    Janesky, J
    Pietambaram, S
    Rizzo, ND
    Slaughter, JM
    Smith, K
    Sun, JJ
    Tehrani, S
    MRS BULLETIN, 2004, 29 (11) : 818 - 821
  • [5] Research on Progress of Computing In-Memory Based on Static Random-Access Memory
    Lin Zhiting
    Xu Tian
    Tong Zhongzhen
    Wu Xiulong
    Wang Fangming
    Peng Chunyu
    Lu Wenjuan
    Zhao Qiang
    Chen Junning
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (11) : 4041 - 4057
  • [6] Spin-transfer torque magnetoresistive random-access memory technologies for normally off computing (invited)
    Ando, K.
    Fujita, S.
    Ito, J.
    Yuasa, S.
    Suzuki, Y.
    Nakatani, Y.
    Miyazaki, T.
    Yoda, H.
    JOURNAL OF APPLIED PHYSICS, 2014, 115 (17)
  • [7] Ion-Driven Electrochemical Random-Access Memory-Based Synaptic Devices for Neuromorphic Computing Systems: A Mini-Review
    Kang, Heebum
    Seo, Jongseon
    Kim, Hyejin
    Kim, Hyun Wook
    Hong, Eun Ryeong
    Kim, Nayeon
    Lee, Daeseok
    Woo, Jiyong
    MICROMACHINES, 2022, 13 (03)
  • [8] Fast and Accurate Weight Updating Strategy for Resistive Random-Access Memory (RRAM)-Based Neural Networks
    Feng, Yulin
    Huang, Peng
    Chen, Yiyang
    Zhang, Yizhou
    Li, Ruiyi
    Zhou, Zheng
    Liu, Lifeng
    Liu, Xiaoyan
    Kang, Jinfeng
    IEEE ELECTRON DEVICE LETTERS, 2023, 44 (03) : 416 - 419
  • [9] A computing-in-memory macro based on three-dimensional resistive random-access memory
    Qiang Huo
    Yiming Yang
    Yiming Wang
    Dengyun Lei
    Xiangqu Fu
    Qirui Ren
    Xiaoxin Xu
    Qing Luo
    Guozhong Xing
    Chengying Chen
    Xin Si
    Hao Wu
    Yiyang Yuan
    Qiang Li
    Xiaoran Li
    Xinghua Wang
    Meng-Fan Chang
    Feng Zhang
    Ming Liu
    Nature Electronics, 2022, 5 : 469 - 477
  • [10] A computing-in-memory macro based on three-dimensional resistive random-access memory
    Huo, Qiang
    Yang, Yiming
    Wang, Yiming
    Lei, Dengyun
    Fu, Xiangqu
    Ren, Qirui
    Xu, Xiaoxin
    Luo, Qing
    Xing, Guozhong
    Chen, Chengying
    Si, Xin
    Wu, Hao
    Yuan, Yiyang
    Li, Qiang
    Li, Xiaoran
    Wang, Xinghua
    Chang, Meng-Fan
    Zhang, Feng
    Liu, Ming
    NATURE ELECTRONICS, 2022, 5 (07) : 469 - 477