RRAM-Based Analog Approximate Computing

被引:99
|
作者
Li, Boxun [1 ]
Gu, Peng [1 ]
Shan, Yi [2 ]
Wang, Yu [1 ]
Chen, Yiran [3 ]
Yang, Huazhong [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Tsinghua Natl Lab Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Baidu Inc, Baidu Res Inst Deep Learning, Beijing 100085, Peoples R China
[3] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15261 USA
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Approximate computing; neural network; power efficiency; resistive random-access memory (RRAM); NEURAL-NETWORKS; DEVICE; DESIGN; MEMORY;
D O I
10.1109/TCAD.2015.2445741
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Approximate computing is a promising design paradigm for better performance and power efficiency. In this paper, we propose a power efficient framework for analog approximate computing with the emerging metal-oxide resistive switching random-access memory (RRAM) devices. A programmable RRAM-based approximate computing unit (RRAM-ACU) is introduced first to accelerate approximated computation, and an approximate computing framework with scalability is then proposed on top of the RRAM-ACU. In order to program the RRAM-ACU efficiently, we also present a detailed configuration flow, which includes a customized approximator training scheme, an approximator-parameter-to-RRAM-state mapping algorithm, and an RRAM state tuning scheme. Finally, the proposed RRAM-based computing framework is modeled at system level. A predictive compact model is developed to estimate the configuration overhead of RRAM-ACU and help explore the application scenarios of RRAM-based analog approximate computing. The simulation results on a set of diverse benchmarks demonstrate that, compared with a x86-64 CPU at 2 GHz, the RRAM-ACU is able to achieve 4.06-196.41x speedup and power efficiency of 24.59-567.98 GFLOPS/W with quality loss of 8.72% on average. And the implementation of hierarchical model and X application demonstrates that the proposed RRAM-based approximate computing framework can achieve >12.8x power efficiency than its pure digital implementation counterparts (CPU, graphics processing unit, and field-programmable gate arrays).
引用
收藏
页码:1905 / 1917
页数:13
相关论文
共 50 条
  • [31] Temperature-Resilient RRAM-Based In-Memory Computing for DNN Inference
    Meng, Jian
    Shim, Wonbo
    Yang, Li
    Yeo, Injune
    Fan, Deliang
    Yu, Shimeng
    Seo, Jae-sun
    IEEE MICRO, 2022, 42 (01) : 89 - 98
  • [32] Sparse and Robust RRAM-based Efficient In-memory Computing for DNN Inference
    Meng, Jian
    Yeo, Injune
    Yang, Li
    Fan, Deliang
    Seo, Jae-sun
    Yu, Shimeng
    Shim, Wonbo
    2022 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2022,
  • [33] RRAM-based CAM combined with time-domain circuits for hyperdimensional computing
    Halawani, Yasmin
    Kilani, Dima
    Hassan, Eman
    Tesfai, Huruy
    Saleh, Hani
    Mohammad, Baker
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [34] Monolithic 3D Integration of Analog RRAM-Based Computing-in-Memory and Sensor for Energy-Efficient Near-Sensor Computing
    Du, Yiwei
    Tang, Jianshi
    Li, Yijun
    Xi, Yue
    Li, Yuankun
    Li, Jiaming
    Huang, Heyi
    Qin, Qi
    Zhang, Qingtian
    Gao, Bin
    Deng, Ning
    Qian, He
    Wu, Huaqiang
    ADVANCED MATERIALS, 2024, 36 (22)
  • [35] Reliability Perspective on Neuromorphic Computing Based on Analog RRAM
    Wu, Huaqiang
    Zhao, Meiran
    Liu, Yuyi
    Yao, Peng
    Xi, Yue
    Li, Xinyi
    Wu, Wei
    Zhang, Qingtian
    Tang, Jianshi
    Gao, Bin
    Qian, He
    2019 IEEE INTERNATIONAL RELIABILITY PHYSICS SYMPOSIUM (IRPS), 2019,
  • [36] RRAM-based CAM combined with time-domain circuits for hyperdimensional computing
    Yasmin Halawani
    Dima Kilani
    Eman Hassan
    Huruy Tesfai
    Hani Saleh
    Baker Mohammad
    Scientific Reports, 11
  • [37] A RRAM-based Associative Memory Cell
    Pan, Yihan
    Foster, Patrick
    Serb, Alex
    Prodromakis, Themis
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [38] Hardware calibrated learning to compensate heterogeneity in analog RRAM-based Spiking Neural Networks
    Moro, Filippo
    Esmanhotto, E.
    Hirtzlin, T.
    Castellani, N.
    Trabelsi, A.
    Dalgaty, T.
    Molas, G.
    Andrieu, F.
    Brivio, S.
    Spiga, S.
    Indiveri, G.
    Payvand, M.
    Vianello, E.
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 380 - 383
  • [39] Improving the accuracy and robustness of RRAM-based in-memory computing against RRAM hardware noise and adversarial attacks
    Cherupally, Sai Kiran
    Meng, Jian
    Rakin, Adnan Siraj
    Yin, Shihui
    Yeo, Injune
    Yu, Shimeng
    Fan, Deliang
    Seo, Jae-Sun
    SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2022, 37 (03)
  • [40] An RRAM-Based Oscillatory Neural Network
    Jackson, Thomas C.
    Sharma, Abhishek A.
    Bain, James A.
    Weldon, Jeffrey A.
    Pileggi, Lawrence
    2015 IEEE 6TH LATIN AMERICAN SYMPOSIUM ON CIRCUITS & SYSTEMS (LASCAS), 2015,