Memristive-based Mixed-signal CGRA for Accelerating Deep Neural Network Inference

被引:2
|
作者
Kazerooni-Zand, Reza [1 ]
Kamal, Mehdi [2 ]
Afzali-Kusha, Ali [1 ,3 ]
Pedram, Massoud [2 ]
机构
[1] Univ Tehran, Sch Elect & Comp Engn, Coll Engn, North Karegar St, Tehran 1439957131, Iran
[2] Univ Southern Calif, Elect & Comp Engn Dept, 3740 McClintock Ave, Los Angeles, CA USA
[3] Inst Res Fundamental Sci IPM, Sch Comp Sci, Lavasani St, Tehran 1953833511, Iran
关键词
Coarse-grained reconfigurable architecture; accelerator; memristor; Convolutional Neural Network; RELIABILITY IMPROVEMENT; ENERGY; OPTIMIZATION;
D O I
10.1145/3595638
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, a mixed-signal coarse-grained reconfigurable architecture (CGRA) for accelerating inference in deep neural networks (DNNs) is presented. It is based on performing dot-product computations using analog computing to achieve a considerable speed improvement. Other computations are performed digitally. In the proposed structure (called MX-CGRA), analog tiles consisting of memristor crossbars are employed. To reduce the overhead of converting the data between analog and digital domains, we utilize a proper interface between the analog and digital tiles. In addition, the structure benefits from an efficient memory hierarchy where the data is moved as close as possible to the computing fabric. Moreover, to fully utilize the tiles, we define a set of micro instructions to configure the analog and digital domains. Corresponding context words used in the CGRA are determined by these instructions (generated by a companion compiler tool). The efficacy of the MX-CGRA is assessed by modeling the execution of state-of-the-art DNN architectures on this structure. The architectures are used to classify images of the ImageNet dataset. Simulation results show that, compared to the previous mixed-signal DNN accelerators, on average, a higher throughput of 2.35 x is achieved.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Accelerating deep convolutional neural network on FPGA for ECG signal classification
    Aruna, V. B. K. L.
    Chitra, E.
    Padmaja, M.
    MICROPROCESSORS AND MICROSYSTEMS, 2023, 103
  • [22] A memristive deep belief neural network based on silicon synapses
    Wang, Wei
    Danial, Loai
    Li, Yang
    Herbelin, Eric
    Pikhay, Evgeny
    Roizin, Yakov
    Hoffer, Barak
    Wang, Zhongrui
    Kvatinsky, Shahar
    NATURE ELECTRONICS, 2022, 5 (12) : 870 - 880
  • [23] A memristive deep belief neural network based on silicon synapses
    Wei Wang
    Loai Danial
    Yang Li
    Eric Herbelin
    Evgeny Pikhay
    Yakov Roizin
    Barak Hoffer
    Zhongrui Wang
    Shahar Kvatinsky
    Nature Electronics, 2022, 5 : 870 - 880
  • [24] Compact Mixed-Signal Convolutional Neural Network Using a Single Modular Neuron
    Chang, Dong-Jin
    Nam, Byeong-Gyu
    Ryu, Seung-Tak
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2020, 67 (12) : 5189 - 5199
  • [25] Circuit Connectivity Inspired Neural Network for Analog Mixed-Signal Functional Modeling
    Hassanpourghadi, Mohsen
    Su, Shiyu
    Rasul, Rezwan A.
    Liu, Juzheng
    Zhang, Qiaochu
    Chen, Mike Shuo-Wei
    2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, : 505 - 510
  • [26] A mixed-signal oscillatory neural network for scalable analog computations in phase domain
    Delacour, Corentin
    Carapezzi, Stefania
    Boschetto, Gabriele
    Abernot, Madeleine
    Gil, Thierry
    Azemard, Nadine
    Todri-Sanial, Aida
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (03):
  • [27] Neural network integrated circuits with single-block mixed-signal arrays
    Djahanshahi, H
    Ahmadi, M
    Jullien, GA
    Miller, WC
    THIRTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, VOLS 1 AND 2, 1998, : 1130 - 1135
  • [28] Analog/Mixed-Signal Standard Cell Based Approach for Automated Circuit Generation of Neural Network Accelerators
    Mueller, Roland
    Mateu, Loreto
    Brederlow, Ralf
    2023 38TH CONFERENCE ON DESIGN OF CIRCUITS AND INTEGRATED SYSTEMS, DCIS, 2023,
  • [29] Mitigating Non-idealities of Memristive-based Artificial Neural Networks - an Algorithmic Approach
    Mehonic, Adnan
    Joksas, Dovydas
    Barmpatsalos, Nikolaos
    Ng, Wing H.
    Kenyon, Anthony J.
    Wang, Erwei
    Constantinides, George
    6TH IEEE ELECTRON DEVICES TECHNOLOGY AND MANUFACTURING CONFERENCE (EDTM 2022), 2022, : 399 - 401
  • [30] Synchronization robustness analysis of memristive-based neural networks with deviating arguments and stochastic perturbations
    Xie, Tao
    Xiong, Xing
    Zhang, Qike
    AIMS MATHEMATICS, 2024, 9 (01): : 918 - 941