Influence of variability on the performance of HfO2 memristor-based convolutional neural networks

被引:7
|
作者
Romero-Zaliz, R. [1 ]
Perez, E. [2 ]
Jimenez-Molinos, F. [3 ]
Wenger, C. [2 ,4 ]
Roldan, J. B. [3 ]
机构
[1] Granada Univ, Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
[2] IHP Leibniz Inst Innovat Mikroelekt, Frankfurt, Oder, Germany
[3] Univ Granada, Dept Elect & Tecnol Comp, Granada, Spain
[4] BTU Cottbus Senftenberg, Cottbus, Germany
关键词
Memristors; Multilevel RRAMs; Hardware neural networks; Variability;
D O I
10.1016/j.sse.2021.108064
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A study of convolutional neural networks (CNNs) was performed to analyze the influence of quantization and variability in the network synaptic weights. Different CNNs were considered accounting for the number of convolutional layers, size of the filters in the convolutional layer, number of neurons in the final network layers and different sets of quantization levels. The conductance levels of fabricated 1T1R structures based on HfO2 memristors were considered as reference for four or eight level quantization processes at the inference stage of the CNNs, which were previous trained with the MNIST dataset. We also included the variability of the experimental conductance levels that was found to be Gaussian distributed and was correspondingly modeled for the synaptic weight implementation.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] Bipartite synchronization for inertia memristor-based neural networks on coopetition networks
    Li, Ning
    Zheng, Wei Xing
    NEURAL NETWORKS, 2020, 124 : 39 - 49
  • [32] Memristor-based neural circuits
    Corinto, Fernando
    Ascoli, Alon
    Kang, Sung-Mo Steve
    2013 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2013, : 417 - 420
  • [33] Periodic Activation Functions in Memristor-based Analog Neural Networks
    Merkel, Cory
    Kudithipudi, Dhireesha
    Sereni, Nick
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [34] Adaptive Synchronization for Delayed Chaotic Memristor-Based Neural Networks
    Xin, Youming
    Cheng, Zunshui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (02) : 601 - 610
  • [35] Synchronization control of memristor-based recurrent neural networks with perturbations
    Wang, Weiping
    Li, Lixiang
    Peng, Haipeng
    Xiao, Jinghua
    Yang, Yixian
    NEURAL NETWORKS, 2014, 53 : 8 - 14
  • [36] On synchronization of competitive memristor-based neural networks by nonlinear control
    Zheng, Cheng-De
    Zhang, Lulu
    NEUROCOMPUTING, 2020, 410 : 151 - 160
  • [37] The Research of Fault Tolerance of Memristor-Based Artificial Neural Networks
    Danilin, S. N.
    Shchanikov, S. A.
    Zuev, A. D.
    Bordanov, I. A.
    Sakulin, A. E.
    12TH INTERNATIONAL CONFERENCE ON THE DEVELOPMENTS IN ESYSTEMS ENGINEERING (DESE 2019), 2019, : 539 - 544
  • [38] Synchronization control of a class of memristor-based recurrent neural networks
    Wu, Ailong
    Wen, Shiping
    Zeng, Zhigang
    INFORMATION SCIENCES, 2012, 183 (01) : 106 - 116
  • [39] Fault Modeling and Testing of Memristor-Based Spiking Neural Networks
    Hou, Kuan-Wei
    Cheng, Hsueh-Hung
    Tung, Chi
    Wu, Cheng-Wen
    Lu, Juin-Ming
    2022 IEEE INTERNATIONAL TEST CONFERENCE (ITC), 2022, : 92 - 99
  • [40] A Compact Memristor-Based Dynamic Synapse for Spiking Neural Networks
    Hu, Miao
    Chen, Yiran
    Yang, J. Joshua
    Wang, Yu
    Li, Hai
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2017, 36 (08) : 1353 - 1366