A Framework to Explore Workload-Specific Performance and Lifetime Trade-offs in Neuromorphic Computing

被引:17
|
作者
Balaji, Adarsha [1 ]
Song, Shihao [1 ]
Das, Anup [1 ]
Dutt, Nikil [2 ]
Krichmar, Jeff [2 ]
Kandasamy, Nagarajan [1 ]
Catthoor, Francky [3 ,4 ]
机构
[1] Drexel Univ, Philadelphia, PA 19104 USA
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92697 USA
[3] IMEC, B-3001 Leuven, Belgium
[4] Katholieke Univ Leuven, B-3000 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Charge pumps; Aging; Neurons; Hardware; Synapses; Negative bias temperature instability; Thermal variables control; Neuromorphic computing; non-voltaile memory (NVM); phase-change memory (PCM); wear-out; negative bias temperature instability (NBTI); spiking neural networks (SNNs); and inter-spike interval (ISI);
D O I
10.1109/LCA.2019.2951507
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic hardware with non-volatile memory (NVM) can implement machine learning workload in an energy-efficient manner. Unfortunately, certain NVMs such as phase change memory (PCM) require high voltages for correct operation. These voltages are supplied from an on-chip charge pump. If the charge pump is activated too frequently, its internal CMOS devices do not recover from stress, accelerating their aging and leading to negative bias temperature instability (NBTI) generated defects. Forcefully discharging the stressed charge pump can lower the aging rate of its CMOS devices, but makes the neuromorphic hardware unavailable to perform computations while its charge pump is being discharged. This negatively impacts performance such as latency and accuracy of the machine learning workload being executed. In this letter, we propose a novel framework to exploit workload-specific performance and lifetime trade-offs in neuromorphic computing. Our framework first extracts the precise times at which a charge pump in the hardware is activated to support neural computations within a workload. This timing information is then used with a characterized NBTI reliability model to estimate the charge pumps aging during the workload execution. We use our framework to evaluate workload-specific performance and reliability impacts of using 1) different SNN mapping strategies and 2) different charge pump discharge strategies. We show that our framework can be used by system designers to explore performance and reliability trade-offs early in the design of neuromorphic hardware such that appropriate reliability-oriented design margins can be set.
引用
收藏
页码:149 / 152
页数:4
相关论文
共 50 条
  • [1] Reliability-Performance Trade-offs in Neuromorphic Computing
    Titirsha, Twisha
    Das, Anup
    2020 11TH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING WORKSHOPS (IGSC), 2020,
  • [2] Power and Performance trade-offs for mobile computing systems
    Fayed, Ayman
    Combs, Eryn
    Mills, Anatolii
    2011 INTERNATIONAL CONFERENCE ON ENERGY AWARE COMPUTING, 2011,
  • [3] Power-performance trade-offs for reconfigurable computing
    Noguera, J
    Badia, RM
    INTERNATIONAL CONFERENCE ON HARDWARE/SOFTWARE CODESIGN AND SYSTEM SYNTHESIS, 2004, : 116 - 121
  • [4] Maladaptive explore/exploit trade-offs in schizophrenia
    Speers, Lucinda J.
    Bilkey, David K.
    TRENDS IN NEUROSCIENCES, 2023, 46 (05) : 341 - 354
  • [5] Optimizing the trade-offs between cost and performance in Scientific Computing
    Nunez, Alberto
    Andres, Cesar
    Merayo, Mercedes G.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, ICCS 2012, 2012, 9 : 498 - 507
  • [6] Understanding the Trade-offs of Device, Circuit and Application in ReRAM-based Neuromorphic Computing Systems
    Yan, Bonan
    Liu, Chenchen
    Liu, Xiaoxiao
    Chen, Yiran
    Li, Hai
    2017 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2017,
  • [7] Risk and Return Trade-Offs in Lifetime Earnings
    Dillon, Eleanor W.
    JOURNAL OF LABOR ECONOMICS, 2018, 36 (04) : 981 - 1021
  • [8] TRADE-OFFS AND PERFORMANCE CONSIDERATIONS
    LOWRY, SR
    HUPPLER, DA
    VIDRINE, DW
    PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1981, 289 : 132 - 134
  • [9] Predicting Price/Performance Trade-offs for Whitney: A Commodity Computing Cluster
    Jeffrey C. Becker
    Bill Nitzberg
    Rob F. Van Der Wijngaart
    Maurice Yarrow
    The Journal of Supercomputing, 1999, 13 : 303 - 319
  • [10] Predicting cost/performance trade-offs for Whitney: A commodity computing cluster
    Becker, JC
    Nitzberg, B
    Van Der Wijngaart, RF
    PROCEEDINGS OF THE THIRTY-FIRST HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, VOL VII: SOFTWARE TECHNOLOGY TRACK, 1998, : 504 - 513