Influence of variability on the performance of HfO2 memristor-based convolutional neural networks

被引:7
|
作者
Romero-Zaliz, R. [1 ]
Perez, E. [2 ]
Jimenez-Molinos, F. [3 ]
Wenger, C. [2 ,4 ]
Roldan, J. B. [3 ]
机构
[1] Granada Univ, Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
[2] IHP Leibniz Inst Innovat Mikroelekt, Frankfurt, Oder, Germany
[3] Univ Granada, Dept Elect & Tecnol Comp, Granada, Spain
[4] BTU Cottbus Senftenberg, Cottbus, Germany
关键词
Memristors; Multilevel RRAMs; Hardware neural networks; Variability;
D O I
10.1016/j.sse.2021.108064
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A study of convolutional neural networks (CNNs) was performed to analyze the influence of quantization and variability in the network synaptic weights. Different CNNs were considered accounting for the number of convolutional layers, size of the filters in the convolutional layer, number of neurons in the final network layers and different sets of quantization levels. The conductance levels of fabricated 1T1R structures based on HfO2 memristors were considered as reference for four or eight level quantization processes at the inference stage of the CNNs, which were previous trained with the MNIST dataset. We also included the variability of the experimental conductance levels that was found to be Gaussian distributed and was correspondingly modeled for the synaptic weight implementation.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Memristor-based neural networks with weight simultaneous perturbation training
    Wang, Chunhua
    Xiong, Lin
    Sun, Jingru
    Yao, Wei
    NONLINEAR DYNAMICS, 2019, 95 (04) : 2893 - 2906
  • [42] Modeling affections with memristor-based associative memory neural networks
    Hu, Xiaofang
    Duan, Shukai
    Chen, Guanrong
    Chen, Ling
    NEUROCOMPUTING, 2017, 223 : 129 - 137
  • [43] Determining operation tolerances of memristor-based artificial neural networks
    Danilin, S. N.
    Shchanikov, S. A.
    Panteleev, S. V.
    2016 INTERNATIONAL CONFERENCE ON ENGINEERING AND TELECOMMUNICATION (ENT 2016), 2016, : 34 - 38
  • [44] Finite-time synchronization of memristor-based neural networks
    Bao, Haibo
    Park, Ju H.
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 1732 - 1735
  • [45] On Memristor-Based Impulsive Neural Networks with Time-Delay
    Hu, Bin
    Guan, Zhi-Hong
    Liu, Zhi-Wei
    Jiang, Xiao-Wei
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 4748 - 4753
  • [46] Adaptive synchronization of memristor-based neural networks with discontinuous activations
    Li, Yueheng
    Luo, Biao
    Liu, Derong
    Yang, Zhanyu
    Zhu, Yunli
    NEUROCOMPUTING, 2020, 381 : 196 - 206
  • [47] Memristor-based neural networks with weight simultaneous perturbation training
    Chunhua Wang
    Lin Xiong
    Jingru Sun
    Wei Yao
    Nonlinear Dynamics, 2019, 95 : 2893 - 2906
  • [48] Memristor-based neural networks: Synaptic versus neuronal stochasticity
    Naous, Rawan
    AlShedivat, Maruan
    Neftci, Emre
    Cauwenberghs, Gert
    Salama, Khaled Nabil
    AIP ADVANCES, 2016, 6 (11):
  • [49] Finite-time stabilization control of memristor-based neural networks
    Cai, Zuowei
    Huang, Lihong
    Zhu, Mingxun
    Wang, Dongshu
    NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2016, 20 : 37 - 54
  • [50] Lagrange Stability of Complex-Valued Memristor-Based Neural Networks
    Wang, Nengjie
    Li, Biwen
    2017 14TH INTERNATIONAL WORKSHOP ON COMPLEX SYSTEMS AND NETWORKS (IWCSN), 2017, : 144 - 148