RRAM-Based Analog Approximate Computing

被引:99
|
作者
Li, Boxun [1 ]
Gu, Peng [1 ]
Shan, Yi [2 ]
Wang, Yu [1 ]
Chen, Yiran [3 ]
Yang, Huazhong [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Baidu Inc, Baidu Res Inst Deep Learning, Beijing 100085, Peoples R China
[3] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15261 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Approximate computing; neural network; power efficiency; resistive random-access memory (RRAM); NEURAL-NETWORKS; DEVICE; DESIGN; MEMORY;
D O I
10.1109/TCAD.2015.2445741
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate computing is a promising design paradigm for better performance and power efficiency. In this paper, we propose a power efficient framework for analog approximate computing with the emerging metal-oxide resistive switching random-access memory (RRAM) devices. A programmable RRAM-based approximate computing unit (RRAM-ACU) is introduced first to accelerate approximated computation, and an approximate computing framework with scalability is then proposed on top of the RRAM-ACU. In order to program the RRAM-ACU efficiently, we also present a detailed configuration flow, which includes a customized approximator training scheme, an approximator-parameter-to-RRAM-state mapping algorithm, and an RRAM state tuning scheme. Finally, the proposed RRAM-based computing framework is modeled at system level. A predictive compact model is developed to estimate the configuration overhead of RRAM-ACU and help explore the application scenarios of RRAM-based analog approximate computing. The simulation results on a set of diverse benchmarks demonstrate that, compared with a x86-64 CPU at 2 GHz, the RRAM-ACU is able to achieve 4.06-196.41x speedup and power efficiency of 24.59-567.98 GFLOPS/W with quality loss of 8.72% on average. And the implementation of hierarchical model and X application demonstrates that the proposed RRAM-based approximate computing framework can achieve >12.8x power efficiency than its pure digital implementation counterparts (CPU, graphics processing unit, and field-programmable gate arrays).
引用
收藏
页码:1905 / 1917
页数:13
相关论文
共 50 条
  • [41] On the Reliability of RRAM-Based Neural Networks
    Aziza, Hassen
    Zambelli, Cristian
    Hamdioui, Said
    Diware, Sumit
    Bishnoi, Rajendra
    Gebregiorgis, Anteneh
    2023 IFIP/IEEE 31ST INTERNATIONAL CONFERENCE ON VERY LARGE SCALE INTEGRATION, VLSI-SOC, 2023, : 13 - 20
  • [42] An RRAM-based MLC design approach
    Bagheri-Soulla, A. A.
    Ghaznavi-Ghoushchi, M. B.
    MICROELECTRONICS JOURNAL, 2017, 64 : 9 - 18
  • [43] An RRAM-Based Digital Computing-in-Memory Macro With Dynamic Voltage Sense Amplifier and Sparse-Aware Approximate Adder Tree
    He, Yifan
    Yue, Jinshan
    Feng, Xiaoyu
    Huang, Yuxuan
    Jia, Hongyang
    Wang, Jingyu
    Zhang, Lu
    Sun, Wenyu
    Yang, Huazhong
    Liu, Yongpan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (02) : 416 - 420
  • [44] Time-Dependent Variability in RRAM-based Analog Neuromorphic System for Pattern Recognition
    Kang, Jian
    Yu, Zhizhen
    Wu, Lindong
    Fang, Yichen
    Wang, Zongwei
    Cai, Yimao
    Ji, Zhigang
    Zhang, Jianfu
    Wang, Runsheng
    Yang, Yuchao
    Huang, Ru
    2017 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2017,
  • [45] RRAM-Based TCAMs for Pattern Search
    Zheng, Le
    Shin, Sangho
    Lloyd, Scott
    Gokhale, Maya
    Kim, Kyungmin
    Kang, Sung-Mo
    2016 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2016, : 1382 - 1385
  • [46] RRAM: A Fully Input Parallel Charge-Domain RRAM-based Computing-in-Memory Design with High Tolerance for RRAM Variations
    He, Yifan
    Huang, Yuxuan
    Yue, Jinshan
    Sun, Wenyu
    Zhang, Lu
    Liu, Yongpan
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 3279 - 3283
  • [47] Saving Energy of RRAM-Based Neural Accelerator Through State-Aware Computing
    He, Yintao
    Wang, Ying
    Li, Huawei
    Li, Xiaowei
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2022, 41 (07) : 2115 - 2127
  • [48] Fully Binarized, Parallel, RRAM-Based Computing Primitive for In-Memory Similarity Search
    Kingra, Sandeep Kaur
    Parmar, Vivek
    Verma, Deepak
    Bricalli, Alessandro
    Piccolboni, Giuseppe
    Molas, Gabriel
    Regev, Amir
    Suri, Manan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (01) : 46 - 50
  • [49] An Ultra-Low-Power Analog Multiplier-Divider Compatible with Digital Code for RRAM-Based Computing-in-Memory Macros
    Yang, Yiming
    Lv, Shidong
    Li, Xiaoran
    Wang, Xinghua
    Wang, Qian
    Yuan, Yiyang
    Liang, Sen
    Zhang, Feng
    MICROMACHINES, 2023, 14 (07)
  • [50] HR3AM: A Heat Resilient Design for RRAM-based Neuromorphic Computing
    Liu, Xiao
    Zhou, Mingxuan
    Rosing, Tajana S.
    Zhao, Jishen
    2019 IEEE/ACM INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN (ISLPED), 2019,