Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware

被引:20
|
作者
Balaji, Adarsha [1 ]
Marty, Thibaut [2 ]
Das, Anup [1 ]
Catthoor, Francky [3 ]
机构
[1] Drexel Univ, Philadelphia, PA 19104 USA
[2] ENS Rennes, Rennes, Ille & Vilaine, France
[3] IMEC, Neuromorph Div, B-3001 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Spiking Neural Networks (SNN); Neuromorphic computing; Internet of Things (IoT); Run-time; Mapping; DESIGN; SYSTEM;
D O I
10.1007/s11265-020-01573-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic architectures implement biological neurons and synapses to execute machine learning algorithms with spiking neurons and bio-inspired learning algorithms. These architectures are energy efficient and therefore, suitable for cognitive information processing on resource and power-constrained environments, ones where sensor and edge nodes of internet-of-things (IoT) operate. To map a spiking neural network (SNN) to a neuromorphic architecture, prior works have proposed design-time based solutions, where the SNN is first analyzed offline using representative data and then mapped to the hardware to optimize some objective functions such as minimizing spike communication or maximizing resource utilization. In many emerging applications, machine learning models may change based on the input using some online learning rules. In online learning, new connections may form or existing connections may disappear at run-time based on input excitation. Therefore, an already mapped SNN may need to be re-mapped to the neuromorphic hardware to ensure optimal performance. Unfortunately, due to the high computation time, design-time based approaches are not suitable for remapping a machine learning model at run-time after every learning epoch. In this paper, we propose a design methodology to partition and map the neurons and synapses of online learning SNN-based applications to neuromorphic architectures at run-time. Our design methodology operates in two steps - step 1 is a layer-wise greedy approach to partition SNNs into clusters of neurons and synapses incorporating the constraints of the neuromorphic architecture, and step 2 is a hill-climbing optimization algorithm that minimizes the total spikes communicated between clusters, improving energy consumption on the shared interconnect of the architecture. We conduct experiments to evaluate the feasibility of our algorithm using synthetic and realistic SNN-based applications. We demonstrate that our algorithm reduces SNN mapping time by an average 780x compared to a state-of-the-art design-time based SNN partitioning approach with only 6.25% lower solution quality.
引用
收藏
页码:1293 / 1302
页数:10
相关论文
共 50 条
  • [31] Darwin: A neuromorphic hardware co-processor based on spiking neural networks
    Ma, De
    Shen, Juncheng
    Gu, Zonghua
    Zhang, Ming
    Zhu, Xiaolei
    Xu, Xiaoqiang
    Xu, Qi
    Shen, Yangjing
    Pan, Gang
    JOURNAL OF SYSTEMS ARCHITECTURE, 2017, 77 : 43 - 51
  • [32] Darwin:a neuromorphic hardware co-processor based on Spiking Neural Networks
    Juncheng SHEN
    De MA
    Zonghua GU
    Ming ZHANG
    Xiaolei ZHU
    Xiaoqiang XU
    Qi XU
    Yangjing SHEN
    Gang PAN
    Science China(Information Sciences), 2016, 59 (02) : 232 - 236
  • [33] Mapping of Local and Global Synapses on Spiking Neuromorphic Hardware
    Das, Anup
    Wu, Yuefeng
    Khanh Huynh
    Dell'Anna, Francesco
    Catthoor, Francky
    Schaafsma, Siebren
    PROCEEDINGS OF THE 2018 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2018, : 1217 - 1222
  • [34] Viable run-time reconfiguration of hardware
    Hughes, K
    Gunther, B
    PROCEEDINGS OF THE 3RD AUSTRALASIAN COMPUTER ARCHITECTURE CONFERENCE, ACAC'98, 1998, 20 (04): : 67 - 74
  • [35] Large-Scale Spiking Neural Networks using Neuromorphic Hardware Compatible Models
    Krichmar, Jeffrey L.
    Coussy, Philippe
    Dutt, Nikil
    ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2015, 11 (04)
  • [36] Effect of Heterogeneity on Decorrelation Mechanisms in Spiking Neural Networks: A Neuromorphic-Hardware Study
    Pfeil, Thomas
    Jordan, Jakob
    Tetzlaff, Tom
    Gruebl, Andreas
    Schemmel, Johannes
    Diesmann, Markus
    Meier, Karlheinz
    PHYSICAL REVIEW X, 2016, 6 (02):
  • [37] RESHAPE: A Run-time Dataflow Hardware-based Mapping for CGRA Overlays
    Vieira, Maria
    Canesche, Michael
    Braganca, Lucas
    Campos, Josue
    Silva, Mateus
    Ferreira, Ricardo
    Nacif, Jose A.
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [38] The Implementation and Optimization of Neuromorphic Hardware for Supporting Spiking Neural Networks With MLP and CNN Topologies
    Ye, Wujian
    Chen, Yuehai
    Liu, Yijun
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2023, 42 (02) : 448 - 461
  • [39] Hardware Property Checker for Run-Time Hardware Trojan Detection
    Ngo, Xuan Thuy
    Danger, Jean-Luc
    Guilley, Sylvain
    Najm, Zakaria
    Emery, Olivier
    2015 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN (ECCTD), 2015, : 97 - 100
  • [40] Hardware property checker for run-time Hardware Trojan detection
    Institut MINES-TELECOM, TELECOM ParisTech, CNRS LTCI, UMR 5141, Paris Cedex 13
    75634, France
    不详
    35510, France
    Eur. Conf. Circuit Theory Des., ECCTD, 2015,