Influence of variability on the performance of HfO2 memristor-based convolutional neural networks

被引:7
|
作者
Romero-Zaliz, R. [1 ]
Perez, E. [2 ]
Jimenez-Molinos, F. [3 ]
Wenger, C. [2 ,4 ]
Roldan, J. B. [3 ]
机构
[1] Granada Univ, Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
[2] IHP Leibniz Inst Innovat Mikroelekt, Frankfurt, Oder, Germany
[3] Univ Granada, Dept Elect & Tecnol Comp, Granada, Spain
[4] BTU Cottbus Senftenberg, Cottbus, Germany
关键词
Memristors; Multilevel RRAMs; Hardware neural networks; Variability;
D O I
10.1016/j.sse.2021.108064
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A study of convolutional neural networks (CNNs) was performed to analyze the influence of quantization and variability in the network synaptic weights. Different CNNs were considered accounting for the number of convolutional layers, size of the filters in the convolutional layer, number of neurons in the final network layers and different sets of quantization levels. The conductance levels of fabricated 1T1R structures based on HfO2 memristors were considered as reference for four or eight level quantization processes at the inference stage of the CNNs, which were previous trained with the MNIST dataset. We also included the variability of the experimental conductance levels that was found to be Gaussian distributed and was correspondingly modeled for the synaptic weight implementation.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Influence of variability on the performance of HfO2 memristor-based convolutional neural networks
    Romero-Zaliz, R.
    Pérez, E.
    Jiménez-Molinos, F.
    Wenger, C.
    Roldán, J.B.
    Solid-State Electronics, 2021, 185
  • [2] HfO2 Memristor-Based Flexible Radio Frequency Switches
    Chen, Shih-Chieh
    Yang, Yu-Tao
    Tseng, Yun-Chien
    Chiou, Kun-Dong
    Huang, Po-Wei
    Chih, Jia-Hao
    Liu, Hsien-Yang
    Chou, Tsung-Te
    Jhang, Yang-Yu
    Chen, Chien-Wei
    Kuan, Chun-Hsiao
    Ho, E. Ming
    Chien, Chao-Hsin
    Kuo, Chien-Nan
    Cheng, Yu-Ting
    Lien, Der-Hsien
    ACS NANO, 2024, 19 (01) : 704 - 711
  • [3] Strategies to Improve the Accuracy of Memristor-Based Convolutional Neural Networks
    Pan, Wen-Qian
    Chen, Jia
    Kuang, Rui
    Li, Yi
    He, Yu-Hui
    Feng, Gui-Rong
    Duan, Nian
    Chang, Ting-Chang
    Miao, Xiang-Shui
    IEEE TRANSACTIONS ON ELECTRON DEVICES, 2020, 67 (03) : 895 - 901
  • [5] Quaternary synapses network for memristor-based spiking convolutional neural networks
    Sun, Sheng-Yang
    Li, Jiwei
    Li, Zhiwei
    Liu, Husheng
    Liu, Haijun
    Li, Qingjiang
    IEICE ELECTRONICS EXPRESS, 2019, 16 (05):
  • [6] Advances in Memristor-Based Neural Networks
    Xu, Weilin
    Wang, Jingjuan
    Yan, Xiaobing
    FRONTIERS IN NANOTECHNOLOGY, 2021, 3
  • [7] A training strategy for improving the robustness of memristor-based binarized convolutional neural networks
    Huang, Lixing
    Yu, Hongqi
    Chen, Changlin
    Peng, Jie
    Diao, Jietao
    Nie, Hongshan
    Li, Zhiwei
    Liu, Haijun
    SEMICONDUCTOR SCIENCE AND TECHNOLOGY, 2022, 37 (01)
  • [8] Memristor-Based Binarized Spiking Neural Networks
    Eshraghian, Jason K.
    Wang, Xinxin
    Lu, Wei D.
    IEEE NANOTECHNOLOGY MAGAZINE, 2022, 16 (02) : 14 - 23
  • [9] Offline Training for Memristor-based Neural Networks
    Boquet, Guillem
    Macias, Edwar
    Morell, Antoni
    Serrano, Javier
    Miranda, Enrique
    Lopez Vicario, Jose
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1547 - 1551
  • [10] Memristor-Based Design of Sparse Compact Convolutional Neural Network
    Wen, Shiping
    Wei, Huaqiang
    Yan, Zheng
    Guo, Zhenyuan
    Yang, Yin
    Huang, Tingwen
    Chen, Yiran
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 1431 - 1440