TFix: Exploiting the Natural Redundancy of Ternary Neural Networks for Fault Tolerant In-Memory Vector Matrix Multiplication

被引:1
|
作者
Malhotra, Akul [1 ]
Wang, Chunguang [1 ]
Gupta, Sumeet Kumar [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
关键词
In-Memory Computing; Vector Matrix Multiplication; Ternary Deep Neural Networks; Fault Tolerance;
D O I
10.1109/DAC56929.2023.10247835
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-memory computing (IMC) and quantization have emerged as promising techniques for edge-based deep neural network (DNN) accelerators by reducing their energy, latency and storage requirements. In pursuit of ultra-low precision, ternary precision DNNs (TDNNs) offer high efficiency without sacrificing much inference accuracy. In this work, we explore the impact of hard faults on IMC based TDNNs and propose TFix to enhance their fault tolerance. TFix exploits the natural redundancy present in most ternary IMC bitcells as well as the high weight sparsity in TDNNs to provide up to 40.68% accuracy increase over the baseline with < 6% energy overhead.
引用
收藏
页数:6
相关论文
共 38 条
  • [21] XNOR-SRAM: In-Memory Computing SRAM Macro for Binary/Ternary Deep Neural Networks
    Yin, Shihui
    Jiang, Zhewei
    Seo, Jae-Sun
    Seok, Mingoo
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2020, 55 (06) : 1733 - 1743
  • [22] Recurrent Neural Networks With Column-Wise Matrix-Vector Multiplication on FPGAs
    Que, Zhiqiang
    Nakahara, Hiroki
    Nurvitadhi, Eriko
    Boutros, Andrew
    Fan, Hongxiang
    Zeng, Chenglong
    Meng, Jiuxi
    Tsoi, Kuen Hung
    Niu, Xinyu
    Luk, Wayne
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2022, 30 (02) : 227 - 237
  • [23] Cryogenic In-Memory Matrix-Vector Multiplication using Ferroelectric Superconducting Quantum Interference Device (FE-SQUID)
    Alan, Shamiul
    Hutchins, Jack
    Hossain, Md Shafayat
    Ni, Kai
    Narayanan, Vijaykrishnan
    Aziz, Ahmedullah
    2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,
  • [24] Ternary In-Memory MAC Accelerator With Dual-6T SRAM Cell for Deep Neural Networks
    Wang, Xudong
    Li, Geng
    Sun, Jiacong
    Fan, Huanjie
    Chen, Yong
    Jiao, Hailong
    2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS, 2022, : 246 - 250
  • [25] MViD: Sparse Matrix-Vector Multiplication in Mobile DRAM for Accelerating Recurrent Neural Networks
    Kim, Byeongho
    Chung, Jongwook
    Lee, Eojin
    Jung, Wonkyung
    Lee, Sunjung
    Choi, Jaewan
    Park, Jaehyun
    Wi, Minbok
    Lee, Sukhan
    Ahn, Jung Ho
    IEEE TRANSACTIONS ON COMPUTERS, 2020, 69 (07) : 955 - 967
  • [26] An in-memory computing multiply-and-accumulate circuit based on ternary STT-MRAMs for convolutional neural networks
    Zhao, Guihua
    Jin, Xing
    Ye, Huafeng
    Peng, Yating
    Liu, Wei
    Yin, Ningyuan
    Chen, Weichong
    Chen, Jianjun
    Li, Ximing
    Yu, Zhiyi
    IEICE ELECTRONICS EXPRESS, 2022, 19 (20):
  • [27] A Flexible Precision Multi-Format In-Memory Vector Matrix Multiplication Engine in 65 nm CMOS With RF Machine Learning Support
    Mukherjee, Mandovi
    Long, Yun
    Woo, Jongseok
    Kim, Daehyun
    Rahman, Nael Mizanur
    Dash, Saurabh
    Mukhopadhyay, Saibal
    IEEE SOLID-STATE CIRCUITS LETTERS, 2020, 3 (03): : 450 - 453
  • [28] Filling the Gap: Fault-Tolerant Updates of On-Satellite Neural Networks Using Vector Quantization
    Kondrateva, Olga
    Dietzel, Stefan
    Schambach, Maximilian
    Otterbach, Johannes
    Scheuermann, Bjoern
    2023 IFIP NETWORKING CONFERENCE, IFIP NETWORKING, 2023,
  • [29] In-Memory Vector-Matrix Multiplication in Monolithic Complementary Metal-Oxide-Semiconductor-Memristor Integrated Circuits: Design Choices, Challenges, and Perspectives
    Amirsoleimani, Amirali
    Alibart, Fabien
    Yon, Victor
    Xu, Jianxiong
    Pazhouhandeh, M. Reza
    Ecoffey, Serge
    Beilliard, Yann
    Genov, Roman
    Drouin, Dominique
    ADVANCED INTELLIGENT SYSTEMS, 2020, 2 (11)
  • [30] Fault-Tolerant Deep Neural Networks for Processing-In-Memory based Autonomous Edge Systems
    Wang, Siyue
    Yuan, Geng
    Ma, Xiaolong
    Li, Yanyu
    Lin, Xue
    Kailkhura, Bhavy A.
    PROCEEDINGS OF THE 2022 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2022), 2022, : 424 - 429