Efficient Techniques for Extending Service Time for Memristor-based Neural Networks

被引:1
|
作者
Ma, Yu [1 ,2 ,3 ,4 ]
Zhang, Chengrui [1 ,4 ]
Zhou, Pingqiang [1 ,4 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai, Peoples R China
关键词
Memristor; Neural Networks; Drift;
D O I
10.1109/APCCAS51387.2021.9687674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar array (MCA) based accelerators can be used to accelerate neural networks. However, the conductances of memristors change in the inference processes because of drift phenomena. As the weights are represented as the conductances, the weights also change slowly and the accuracy of neural network degrades. In this paper, we propose two techniques to slow down the accuracy degradation by recovering the accuracy after drifting. Firstly, we introduce one label memristor to monitor the drift degree of the crossbar and change the current-result conversion parameter to recover the accuracy. Secondly, we propose an auto-correction technique to correct the conductance of the label memristor. The conductance of the label memristor is used to change the parameter which is used in current-result conversion phase. Experimental results show that our proposed techniques can increase up to 8x high accuracy (> 95%) time and 3x lifetime (> 80%) for MCA based neural networks.
引用
收藏
页码:81 / 84
页数:4
相关论文
共 50 条
  • [2] Advances in Memristor-Based Neural Networks
    Xu, Weilin
    Wang, Jingjuan
    Yan, Xiaobing
    FRONTIERS IN NANOTECHNOLOGY, 2021, 3
  • [3] On Memristor-Based Impulsive Neural Networks with Time-Delay
    Hu, Bin
    Guan, Zhi-Hong
    Liu, Zhi-Wei
    Jiang, Xiao-Wei
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 4748 - 4753
  • [4] Finite-time synchronization of memristor-based neural networks
    Bao, Haibo
    Park, Ju H.
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1732 - 1735
  • [5] Efficient Techniques for Training the Memristor-based Spiking Neural Networks Targeting Better Speed, Energy and Lifetime
    Ma, Yu
    Zhou, Pingqiang
    2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 390 - 395
  • [6] Finite-time stabilization control of memristor-based neural networks
    Cai, Zuowei
    Huang, Lihong
    Zhu, Mingxun
    Wang, Dongshu
    NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2016, 20 : 37 - 54
  • [7] Exponential synchronization of memristor-based recurrent neural networks with time delays
    Wu, Ailong
    Zeng, Zhigang
    Zhu, Xusheng
    Zhang, Jine
    NEUROCOMPUTING, 2011, 74 (17) : 3043 - 3050
  • [8] Fixed-time synchronization of the impulsive memristor-based neural networks
    Zhang, Yanlin
    Zhuang, Jinshen
    Xia, Yonghui
    Bai, Yuzhen
    Cao, Jinde
    Gu, Longfei
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2019, 77 : 40 - 53
  • [9] Convergence and attractivity of memristor-based cellular neural networks with time delays
    Qin, Sitian
    Wang, Jun
    Xue, Xiaoping
    NEURAL NETWORKS, 2015, 63 : 223 - 233
  • [10] Memristor-Based Binarized Spiking Neural Networks
    Eshraghian, Jason K.
    Wang, Xinxin
    Lu, Wei D.
    IEEE NANOTECHNOLOGY MAGAZINE, 2022, 16 (02) : 14 - 23