RRAM-Based Analog Approximate Computing

被引:99
|
作者
Li, Boxun [1 ]
Gu, Peng [1 ]
Shan, Yi [2 ]
Wang, Yu [1 ]
Chen, Yiran [3 ]
Yang, Huazhong [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Baidu Inc, Baidu Res Inst Deep Learning, Beijing 100085, Peoples R China
[3] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15261 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Approximate computing; neural network; power efficiency; resistive random-access memory (RRAM); NEURAL-NETWORKS; DEVICE; DESIGN; MEMORY;
D O I
10.1109/TCAD.2015.2445741
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate computing is a promising design paradigm for better performance and power efficiency. In this paper, we propose a power efficient framework for analog approximate computing with the emerging metal-oxide resistive switching random-access memory (RRAM) devices. A programmable RRAM-based approximate computing unit (RRAM-ACU) is introduced first to accelerate approximated computation, and an approximate computing framework with scalability is then proposed on top of the RRAM-ACU. In order to program the RRAM-ACU efficiently, we also present a detailed configuration flow, which includes a customized approximator training scheme, an approximator-parameter-to-RRAM-state mapping algorithm, and an RRAM state tuning scheme. Finally, the proposed RRAM-based computing framework is modeled at system level. A predictive compact model is developed to estimate the configuration overhead of RRAM-ACU and help explore the application scenarios of RRAM-based analog approximate computing. The simulation results on a set of diverse benchmarks demonstrate that, compared with a x86-64 CPU at 2 GHz, the RRAM-ACU is able to achieve 4.06-196.41x speedup and power efficiency of 24.59-567.98 GFLOPS/W with quality loss of 8.72% on average. And the implementation of hierarchical model and X application demonstrates that the proposed RRAM-based approximate computing framework can achieve >12.8x power efficiency than its pure digital implementation counterparts (CPU, graphics processing unit, and field-programmable gate arrays).
引用
收藏
页码:1905 / 1917
页数:13
相关论文
共 50 条
  • [1] Exploring the Precision Limitation for RRAM-Based Analog Approximate Computing
    Li, Boxun
    Gu, Peng
    Wang, Yu
    Yang, Huazhong
    IEEE DESIGN & TEST, 2016, 33 (01) : 52 - 59
  • [2] RRAM-based Analog In-Memory Computing
    Chen, Xiaoming
    Song, Tao
    Han, Yinhe
    2021 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), 2021,
  • [3] RVComp: Analog Variation Compensation for RRAM-based In-Memory Computing
    He, Jingyu
    Lastras, Miguel
    Ye, Terry Tao
    Tsui, Chi-Ying
    Cheng, Kwang-Ting
    2023 28TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC, 2023, : 246 - 251
  • [4] Logic Synthesis for RRAM-Based In-Memory Computing
    Shirinzadeh, Saeideh
    Soeken, Mathias
    Gaillardon, Pierre-Emmanuel
    Drechsler, Rolf
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2018, 37 (07) : 1422 - 1435
  • [5] Reliability Improvement in RRAM-based DNN for Edge Computing
    Oli-Uz-Zaman, Md
    Khan, Saleh Ahmad
    Yuan, Geng
    Wang, Yanzhi
    Liao, Zhiheng
    Fu, Jingyan
    Ding, Caiwen
    Wang, Jinhui
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 581 - 585
  • [6] Bidirectional Analog Conductance Modulation for RRAM-Based Neural Networks
    Jiang, Zizhen
    Wang, Ziwen
    Zheng, Xin
    Fong, Scott W.
    Qin, Shengjun
    Chen, Hong-Yu
    Ahn, Ethan C.
    Cao, Ji
    Nishi, Yoshio
    Wong, S. Simon
    Wong, H-S. Philip
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2020, 67 (11) : 4904 - 4910
  • [7] Hardware Implementation of Next Generation Reservoir Computing with RRAM-Based Hybrid Digital-Analog System
    Dong, Danian
    Zhang, Woyu
    Xie, Yuanlu
    Yue, Jinshan
    Ren, Kuan
    Huang, Hongjian
    Zheng, Xu
    Sun, Wen Xuan
    Lai, Jin Ru
    Fan, Shaoyang
    Wang, Hongzhou
    Yu, Zhaoan
    Yao, Zhihong
    Xu, Xiaoxin
    Shang, Dashan
    Liu, Ming
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (10)
  • [8] Variability-Aware Design of RRAM-Based Analog CAMs
    Bazzi, Jinane
    Sweidan, Jana
    Fouda, Mohammed E.
    Kanj, Rouwaida
    Eltawil, Ahmed M.
    IEEE ACCESS, 2024, 12 : 55859 - 55873
  • [9] Rescuing RRAM-Based Computing From Static and Dynamic Faults
    Lin, Jilan
    Wen, Cheng-Da
    Hu, Xing
    Tang, Tianqi
    Lin, Ing-Chao
    Wang, Yu
    Xie, Yuan
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2021, 40 (10) : 2049 - 2062
  • [10] Fault Modeling and Testing of RRAM-based Computing-In Memories
    Yang, Yu Cheng
    Li, Jin-Fu
    2022 IEEE INTERNATIONAL TEST CONFERENCE IN ASIA (ITC-ASIA 2022), 2022, : 7 - 12