FPGA-based acceleration for binary neural networks in edge computing

被引:1
|
作者
Zhan J.-Y. [1 ]
Yu A.-T. [1 ]
Jiang W. [1 ]
Yang Y.-J. [1 ]
Xie X.-N. [2 ]
Chang Z.-W. [3 ]
Yang J.-H. [4 ]
机构
[1] School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu
[2] School of Automation, Chengdu University of Information Technology, Chengdu
[3] State Grid Sichuan Electric Power Research Institute, Chengdu
[4] Department of Information Sciences and Technology, George Mason University, Fairfax
基金
中国国家自然科学基金;
关键词
Accelerator; Binarization; Field-programmable gate array (FPGA); Neural networks; Quantification;
D O I
10.1016/j.jnlest.2023.100204
中图分类号
学科分类号
摘要
As a core component in intelligent edge computing, deep neural networks (DNNs) will increasingly play a critically important role in addressing the intelligence-related issues in the industry domain, like smart factories and autonomous driving. Due to the requirement for a large amount of storage space and computing resources, DNNs are unfavorable for resource-constrained edge computing devices, especially for mobile terminals with scarce energy supply. Binarization of DNN has become a promising technology to achieve a high performance with low resource consumption in edge computing. Field-programmable gate array (FPGA)-based acceleration can further improve the computation efficiency to several times higher compared with the central processing unit (CPU) and graphics processing unit (GPU). This paper gives a brief overview of binary neural networks (BNNs) and the corresponding hardware accelerator designs on edge computing environments, and analyzes some significant studies in detail. The performances of some methods are evaluated through the experiment results, and the latest binarization technologies and hardware acceleration methods are tracked. We first give the background of designing BNNs and present the typical types of BNNs. The FPGA implementation technologies of BNNs are then reviewed. Detailed comparison with experimental evaluation on typical BNNs and their FPGA implementation is further conducted. Finally, certain interesting directions are also illustrated as future work. © 2023 The Authors
引用
收藏
相关论文
共 50 条
  • [41] Efficient Hardware Acceleration of Spiking Neural Networks using FPGA: Towards Real-Time Edge Neuromorphic Computing
    El Maachi, Soukaina
    Chehri, Abdellah
    Saadane, Rachid
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [42] FPGA-Based Generation of Autowaves in Memristive Cellular Neural Networks
    Viet-Thanh Pham
    Buscarino, Arturo
    Frasca, Mattia
    Fortuna, Luigi
    Thang Manh Hoang
    2012 13TH INTERNATIONAL WORKSHOP ON CELLULAR NANOSCALE NETWORKS AND THEIR APPLICATIONS (CNNA), 2012,
  • [43] FPGA-based Accelerator for Losslessly Quantized Convolutional Neural Networks
    Sit, Mankit
    Kazami, Ryosuke
    Amano, Hideharu
    2017 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE TECHNOLOGY (ICFPT), 2017, : 295 - 298
  • [44] A Digital Memristor Emulator for FPGA-Based Artificial Neural Networks
    Vourkas, Ioannis
    Abusleme, Angel
    Ntinas, Vasileios
    Sirakoulis, Georgios Ch.
    2016 1ST IEEE INTERNATIONAL VERIFICATION AND SECURITY WORKSHOP (IVSW), 2016, : 54 - 57
  • [45] FPGA-Based Space Vector PWM with Artificial Neural Networks
    Osorio, J.
    Ponce, P.
    Molina, A.
    2012 9TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, COMPUTING SCIENCE AND AUTOMATIC CONTROL (CCE), 2012,
  • [46] Evolutionary FPGA-Based Spiking Neural Networks for Continual Learning
    Otero, Andres
    Sanllorente, Guillermo
    de la Torre, Eduardo
    Nunez-Yanez, Jose
    APPLIED RECONFIGURABLE COMPUTING. ARCHITECTURES, TOOLS, AND APPLICATIONS, ARC 2023, 2023, 14251 : 260 - 274
  • [47] Customizable FPGA-based Accelerator for Binarized Graph Neural Networks
    Wang, Ziwei
    Que, Zhiqiang
    Luk, Wayne
    Fan, Hongxiang
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 1968 - 1972
  • [48] An FPGA-based Accelerator Implementation for Deep Convolutional Neural Networks
    Zhou, Yongmei
    Jiang, Jingfei
    PROCEEDINGS OF 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2015), 2015, : 829 - 832
  • [49] Optimizing Bayesian Recurrent Neural Networks on an FPGA-based Accelerator
    Ferianc, Martin
    Que, Zhiqiang
    Fan, Hongxiang
    Luk, Wayne
    Rodrigues, Miguel
    2021 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (ICFPT), 2021, : 19 - 28
  • [50] Customizable FPGA-based Accelerator for Binarized Graph Neural Networks
    Wang, Ziwei
    Que, Zhiqiang
    Luk, Wayne
    Fan, Hongxiang
    Proceedings - IEEE International Symposium on Circuits and Systems, 2022, 2022-May : 1968 - 1972