RRAM-Based Analog Approximate Computing

被引:99
|
作者
Li, Boxun [1 ]
Gu, Peng [1 ]
Shan, Yi [2 ]
Wang, Yu [1 ]
Chen, Yiran [3 ]
Yang, Huazhong [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Baidu Inc, Baidu Res Inst Deep Learning, Beijing 100085, Peoples R China
[3] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15261 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Approximate computing; neural network; power efficiency; resistive random-access memory (RRAM); NEURAL-NETWORKS; DEVICE; DESIGN; MEMORY;
D O I
10.1109/TCAD.2015.2445741
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate computing is a promising design paradigm for better performance and power efficiency. In this paper, we propose a power efficient framework for analog approximate computing with the emerging metal-oxide resistive switching random-access memory (RRAM) devices. A programmable RRAM-based approximate computing unit (RRAM-ACU) is introduced first to accelerate approximated computation, and an approximate computing framework with scalability is then proposed on top of the RRAM-ACU. In order to program the RRAM-ACU efficiently, we also present a detailed configuration flow, which includes a customized approximator training scheme, an approximator-parameter-to-RRAM-state mapping algorithm, and an RRAM state tuning scheme. Finally, the proposed RRAM-based computing framework is modeled at system level. A predictive compact model is developed to estimate the configuration overhead of RRAM-ACU and help explore the application scenarios of RRAM-based analog approximate computing. The simulation results on a set of diverse benchmarks demonstrate that, compared with a x86-64 CPU at 2 GHz, the RRAM-ACU is able to achieve 4.06-196.41x speedup and power efficiency of 24.59-567.98 GFLOPS/W with quality loss of 8.72% on average. And the implementation of hierarchical model and X application demonstrates that the proposed RRAM-based approximate computing framework can achieve >12.8x power efficiency than its pure digital implementation counterparts (CPU, graphics processing unit, and field-programmable gate arrays).
引用
收藏
页码:1905 / 1917
页数:13
相关论文
共 50 条
  • [21] Thermal Induced Retention Degradation of RRAM-based Neuromorphic Computing Chips
    Ma, Awang
    Gao, Bin
    Mou, Xing
    Yao, Peng
    Du, Yiwei
    Tang, Jianshi
    Qian, He
    Wu, Huaqiang
    2023 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM, IRPS, 2023,
  • [22] Error Correction Scheme for Reliable RRAM-Based In-Memory Computing
    Hu, Yixuan
    Cheng, Kaili
    Zhang, Zuodong
    Wang, Runsheng
    Wang, Yuan
    Huang, Ru
    2021 5TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE (EDTM), 2021,
  • [23] Robustness of Neuromorphic Computing with RRAM-based Crossbars and Optical Neural Networks
    Zhang, Grace Li
    Li, Bing
    Zhu, Ying
    Wang, Tianchen
    Shi, Yiyu
    Yin, Xunzhao
    Zhuo, Cheng
    Gu, Huaxi
    Ho, Tsung-Yi
    Schlichtmann, Ulf
    2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 853 - 858
  • [24] Variation Enhanced Attacks Against RRAM-Based Neuromorphic Computing System
    Lv, Hao
    Li, Bing
    Zhang, Lei
    Liu, Cheng
    Wang, Ying
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (05) : 1588 - 1596
  • [25] RRAM-based Neuromorphic Computing: Data Representation, Architecture, Logic, and Programming
    Li Zhang, Grace
    Zhang, Shuhang
    Li, Hai
    Schlichtmann, Ulf
    2022 25TH EUROMICRO CONFERENCE ON DIGITAL SYSTEM DESIGN (DSD), 2022, : 423 - 428
  • [26] Nanoscale RRAM-based synaptic electronics: toward a neuromorphic computing device
    Park, Sangsu
    Noh, Jinwoo
    Choo, Myung-lae
    Sheri, Ahmad Muqeem
    Chang, Man
    Kim, Young-Bae
    Kim, Chang Jung
    Jeon, Moongu
    Lee, Byung-Geun
    Lee, Byoung Hun
    Hwang, Hyunsang
    NANOTECHNOLOGY, 2013, 24 (38)
  • [27] Straightforward data transfer in a blockwise dataflow for an analog RRAM-based CIM system
    Liu, Yuyi
    Gao, Bin
    Yao, Peng
    Liu, Qi
    Zhang, Qingtian
    Wu, Dong
    Tang, Jianshi
    Qian, He
    Wu, Huaqiang
    FRONTIERS IN ELECTRONICS, 2023, 4
  • [28] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Shim, Wonbo
    Yang, Li
    Fan, Deliang
    Yu, Shimeng
    Seo, Jae-Sun
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [29] A Hardware Friendly Variation-Tolerant Framework for RRAM-Based Neuromorphic Computing
    Gu, Fang-Yi
    Yang, Cheng-Han
    Lin, Ing-Chao
    Chang, Da-Wei
    Lu, Darsen D.
    Schlichtmann, Ulf
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2024, 71 (12) : 6419 - 6432
  • [30] Trends and challenges in the circuit and macro of RRAM-based computing-in-memory systems
    Wei, Song -Tao
    Gao, Bin
    Wu, Dong
    Tang, Jian-Shi
    Qian, He
    Wu, Hua-Qiang
    CHIP, 2022, 1 (01):