Special Session: On the Reliability of Conventional and Quantum Neural Network Hardware

被引:10
|
作者
Sadi, Mehdi [1 ]
He, Yi [2 ]
Li, Yanjing [2 ]
Alam, Mahabubul [3 ]
Kundu, Satwik [3 ]
Ghosh, Swaroop [3 ]
Bahrami, Javad [4 ]
Karimi, Naghmeh [4 ]
机构
[1] Auburn Univ, Dept Elect & Comp Engn, Auburn, AL 36849 USA
[2] Univ Chicago, Dept Comp Sci, Chicago, IL 60637 USA
[3] Penn State Univ, Dept Elect & Amp Comp Engn, University Pk, PA 16802 USA
[4] Univ Maryland Baltimore Cty UMBC, Dept Elect & Amp Comp Engn, Baltimore, MD USA
关键词
POWER;
D O I
10.1109/VTS52500.2021.9794194
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Networks (NNs) are being extensively used in critical applications such as aerospace, healthcare, autonomous driving, and military, to name a few. Limited precision of the underlying hardware platforms, permanent and transient faults injected unintentionally as well as maliciously, and voltage/temperature fluctuations can potentially result in malfunctions in NNs with consequences ranging from substantial reduction in the network accuracy to jeopardizing the correct prediction of the network in worst cases. To alleviate such reliability concerns, this paper discusses the state-of-the-art reliability enhancement schemes that can be tailored for deep learning accelerators. We will discuss the errors associated with the hardware implementation of Deep-Learning (DL) algorithms along with their corresponding countermeasures. An in-field self-test methodology with a high test coverage is introduced, and an accurate high-level framework, so-called FIdelity, is proposed that enables the designers to evaluate DL accelerators in presence of such errors. Then, a state-of-the-art robustness-preserving training algorithm based on the Hessian Regularization is introduced. This algorithm alleviates the perturbations during inference time with negligible degradation in the accuracy of the network. Finally, Quantum Neural Networks (QNNs) and the methods to make them resilient against a variety of vulnerabilities such as fault injection, spatial and temporal variations in Qubits, and noise in QNNs are discussed.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Impact of High-Level Synthesis on Reliability of Artificial Neural Network Hardware Accelerators
    Traiola, Marcello
    dos Santos, Fernando Fernandes
    Rech, Paolo
    Cazzaniga, Carlo
    Sentieys, Olivier
    Kritikakou, Angeliki
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2024, 71 (04) : 845 - 853
  • [22] Generic quantum hardware accelerators for conventional systems
    Bir, Parth
    HARDWARE ACCELERATOR SYSTEMS FOR ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING, 2021, 122 : 97 - 133
  • [23] Special Session: Reliability Assessment Recipes for DNN Accelerators
    Ahmadilivani, Mohammad Hasan
    Bosio, Alberto
    Deveautour, Bastien
    dos Santos, Fernando Fernandes
    Guerrero-Balaguera, Juan-David
    Jenihhin, Maksim
    Kritikakou, Angeliki
    Sierra, Robert Limas
    Pappalardo, Salvatore
    Raik, Jaan
    Condia, Josie E. Rodriguez
    Reorda, Matteo Sonza
    Taheri, Mahdi
    Traiola, Marcello
    2024 IEEE 42ND VLSI TEST SYMPOSIUM, VTS 2024, 2024,
  • [24] Special Session on Reliability and Vulnerability of Neuromorphic Computing Systems
    Yu, Shimeng
    Liu, Chenchen
    Wen, Wujie
    Chen, Yiran
    2018 IEEE 36TH VLSI TEST SYMPOSIUM (VTS 2018), 2018,
  • [25] Special Session: Machine Learning for Semiconductor Test and Reliability
    Amrouch, Hussam
    Chowdhury, Animesh Basak
    Jin, Wentian
    Karri, Ramesh
    Khorrami, Farshad
    Krishnamurthy, Prashanth
    Polian, Ilia
    van Santen, Victor M.
    Tan, Benjamin
    Tan, Sheldon X-D
    2021 IEEE 39TH VLSI TEST SYMPOSIUM (VTS), 2021,
  • [26] Enhancing Neural Network Reliability: Insights From Hardware/Software Collaboration With Neuron Vulnerability Quantization
    Wang, Jing
    Zhu, Jinbin
    Fu, Xin
    Zang, Di
    Li, Keyao
    Zhang, Weigong
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (08) : 1953 - 1966
  • [27] Comparison of SOM and Conventional Neural Network Data Division for PV Reliability Power Prediction
    Pulipaka, Subrahmanyam
    Kumar, Rajneesh
    2017 1ST IEEE INTERNATIONAL CONFERENCE ON ENVIRONMENT AND ELECTRICAL ENGINEERING AND 2017 17TH IEEE INDUSTRIAL AND COMMERCIAL POWER SYSTEMS EUROPE (EEEIC / I&CPS EUROPE), 2017,
  • [28] SPECIAL ISSUE ON NEURAL HARDWARE .1.2.
    RUMACHER, U
    RUCKERT, U
    NEUROCOMPUTING, 1992, 4 (06) : 289 - 290
  • [30] Special Issue on Neural Networks Hardware Implementations
    Linares-Barranco, B
    Andreou, AG
    Indiveri, G
    Shibata, T
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (05): : 976 - 979