Efficient Techniques for Extending Service Time for Memristor-based Neural Networks

被引:1
|
作者
Ma, Yu [1 ,2 ,3 ,4 ]
Zhang, Chengrui [1 ,4 ]
Zhou, Pingqiang [1 ,4 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
[4] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai, Peoples R China
来源
2021 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2021) & 2021 IEEE CONFERENCE ON POSTGRADUATE RESEARCH IN MICROELECTRONICS AND ELECTRONICS (PRIMEASIA 2021) | 2021年
关键词
Memristor; Neural Networks; Drift;
D O I
10.1109/APCCAS51387.2021.9687674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Memristor crossbar array (MCA) based accelerators can be used to accelerate neural networks. However, the conductances of memristors change in the inference processes because of drift phenomena. As the weights are represented as the conductances, the weights also change slowly and the accuracy of neural network degrades. In this paper, we propose two techniques to slow down the accuracy degradation by recovering the accuracy after drifting. Firstly, we introduce one label memristor to monitor the drift degree of the crossbar and change the current-result conversion parameter to recover the accuracy. Secondly, we propose an auto-correction technique to correct the conductance of the label memristor. The conductance of the label memristor is used to change the parameter which is used in current-result conversion phase. Experimental results show that our proposed techniques can increase up to 8x high accuracy (> 95%) time and 3x lifetime (> 80%) for MCA based neural networks.
引用
收藏
页码:81 / 84
页数:4
相关论文
共 50 条
  • [21] Fixed-time synchronization of delayed memristor-based recurrent neural networks
    Jinde CAO
    Ruoxia LI
    ScienceChina(InformationSciences), 2017, 60 (03) : 108 - 122
  • [22] Finite-time synchronization of memristor-based neural networks with mixed delays
    Chen, Chuan
    Li, Lixiang
    Peng, Haipeng
    Yang, Yixian
    Li, Tao
    NEUROCOMPUTING, 2017, 235 : 83 - 89
  • [23] State estimation for memristor-based neural networks with time-varying delays
    Wei, Hongzhi
    Li, Ruoxia
    Chen, Chunrong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (02) : 213 - 225
  • [24] State estimation for memristor-based neural networks with time-varying delays
    Hongzhi Wei
    Ruoxia Li
    Chunrong Chen
    International Journal of Machine Learning and Cybernetics, 2015, 6 : 213 - 225
  • [25] On the periodic dynamics of memristor-based neural networks with time-varying delays
    Chen, Jiejie
    Zeng, Zhigang
    Jiang, Ping
    INFORMATION SCIENCES, 2014, 279 : 358 - 373
  • [26] Finite-time synchronization of stochastic memristor-based delayed neural networks
    Yanchao Shi
    Peiyong Zhu
    Neural Computing and Applications, 2018, 29 : 293 - 301
  • [27] Dissipativity Research on Memristor-based Neural Networks with Time-varying Delays
    Zhang F.
    Li Z.
    Li, Zhi (zhli@xidian.edu.cn), 1600, Sichuan University (49): : 129 - 136
  • [28] TIME:A Training-in-memory Architecture for Memristor-based Deep Neural Networks
    Cheng, Ming
    Xia, Lixue
    Zhu, Zhenhua
    Cai, Yi
    Xie, Yuan
    Wang, Yu
    Yang, Huazhong
    PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [29] Equilibrium Propagation for Memristor-Based Recurrent Neural Networks
    Zoppo, Gianluca
    Marrone, Francesco
    Corinto, Fernando
    FRONTIERS IN NEUROSCIENCE, 2020, 14
  • [30] Exponential stability of memristor-based synchronous switching neural networks with time delays
    Jiang, Yinlu
    Li, Chuandong
    INTERNATIONAL JOURNAL OF BIOMATHEMATICS, 2016, 9 (01)