Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware

被引:20
|
作者
Balaji, Adarsha [1 ]
Marty, Thibaut [2 ]
Das, Anup [1 ]
Catthoor, Francky [3 ]
机构
[1] Drexel Univ, Philadelphia, PA 19104 USA
[2] ENS Rennes, Rennes, Ille & Vilaine, France
[3] IMEC, Neuromorph Div, B-3001 Leuven, Belgium
基金
美国国家科学基金会;
关键词
Spiking Neural Networks (SNN); Neuromorphic computing; Internet of Things (IoT); Run-time; Mapping; DESIGN; SYSTEM;
D O I
10.1007/s11265-020-01573-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neuromorphic architectures implement biological neurons and synapses to execute machine learning algorithms with spiking neurons and bio-inspired learning algorithms. These architectures are energy efficient and therefore, suitable for cognitive information processing on resource and power-constrained environments, ones where sensor and edge nodes of internet-of-things (IoT) operate. To map a spiking neural network (SNN) to a neuromorphic architecture, prior works have proposed design-time based solutions, where the SNN is first analyzed offline using representative data and then mapped to the hardware to optimize some objective functions such as minimizing spike communication or maximizing resource utilization. In many emerging applications, machine learning models may change based on the input using some online learning rules. In online learning, new connections may form or existing connections may disappear at run-time based on input excitation. Therefore, an already mapped SNN may need to be re-mapped to the neuromorphic hardware to ensure optimal performance. Unfortunately, due to the high computation time, design-time based approaches are not suitable for remapping a machine learning model at run-time after every learning epoch. In this paper, we propose a design methodology to partition and map the neurons and synapses of online learning SNN-based applications to neuromorphic architectures at run-time. Our design methodology operates in two steps - step 1 is a layer-wise greedy approach to partition SNNs into clusters of neurons and synapses incorporating the constraints of the neuromorphic architecture, and step 2 is a hill-climbing optimization algorithm that minimizes the total spikes communicated between clusters, improving energy consumption on the shared interconnect of the architecture. We conduct experiments to evaluate the feasibility of our algorithm using synthetic and realistic SNN-based applications. We demonstrate that our algorithm reduces SNN mapping time by an average 780x compared to a state-of-the-art design-time based SNN partitioning approach with only 6.25% lower solution quality.
引用
收藏
页码:1293 / 1302
页数:10
相关论文
共 50 条
  • [1] Run-time Mapping of Spiking Neural Networks to Neuromorphic Hardware
    Adarsha Balaji
    Thibaut Marty
    Anup Das
    Francky Catthoor
    Journal of Signal Processing Systems, 2020, 92 : 1293 - 1302
  • [2] Mapping Spiking Neural Networks to Neuromorphic Hardware
    Balaji, Adarsha
    Das, Anup
    Wu, Yuefeng
    Huynh, Khanh
    Dell'Anna, Francesco G.
    Indiveri, Giacomo
    Krichmar, Jeffrey L.
    Dutt, Nikil D.
    Schaafsma, Siebren
    Catthoor, Francky
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2020, 28 (01) : 76 - 86
  • [3] Dataflow-Based Mapping of Spiking Neural Networks on Neuromorphic Hardware
    Das, Anup
    Kumar, Akash
    PROCEEDINGS OF THE 2018 GREAT LAKES SYMPOSIUM ON VLSI (GLSVLSI'18), 2018, : 419 - 422
  • [4] Endurance-Aware Mapping of Spiking Neural Networks to Neuromorphic Hardware
    Titirsha, Twisha
    Song, Shihao
    Das, Anup
    Krichmar, Jeffrey
    Dutt, Nikil
    Kandasamy, Nagarajan
    Catthoor, Francky
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (02) : 288 - 301
  • [5] Compiling Spiking Neural Networks to Neuromorphic Hardware
    Song, Shihao
    Balaji, Adarsha
    Das, Anup
    Kandasamy, Nagarajan
    Shackleford, James
    21ST ACM SIGPLAN/SIGBED CONFERENCE ON LANGUAGES, COMPILERS, AND TOOLS FOR EMBEDDED SYSTEMS (LCTES '20), 2020, : 38 - 50
  • [6] Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot
    Roggen, D
    Hofmann, S
    Thoma, Y
    Floreano, D
    2003 NASA/DOD CONFERENCE ON EVOLVABLE HARDWARE, 2003, : 189 - 198
  • [7] Advancements in Algorithms and Neuromorphic Hardware for Spiking Neural Networks
    Javanshir, Amirhossein
    Thanh Thi Nguyen
    Mahmud, M. A. Parvez
    Kouzani, Abbas Z.
    NEURAL COMPUTATION, 2022, 34 (06) : 1289 - 1328
  • [8] Community detection with spiking neural networks for neuromorphic hardware
    Hamilton, Kathleen E.
    Imam, Neena
    Humble, Travis S.
    PROCEEDINGS OF NEUROMORPHIC COMPUTING SYMPOSIUM (NCS 2017), 2017,
  • [9] Benchmarking Deep Spiking Neural Networks on Neuromorphic Hardware
    Ostrau, Christoph
    Homburg, Jonas
    Klarhorst, Christian
    Thies, Michael
    Rueckert, Ulrich
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 610 - 621
  • [10] A Design Flow for Mapping Spiking Neural Networks to Many-Core Neuromorphic Hardware
    Song, Shihao
    Varshika, M. Lakshmi
    Das, Anup
    Kandasamy, Nagarajan
    2021 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN (ICCAD), 2021,