Memristor-Based Neural Logic Blocks for Nonlinearly Separable Functions

被引:32
|
作者
Soltiz, Michael [1 ]
Kudithipudi, Dhireesha [1 ]
Merkel, Cory [1 ]
Rose, Garrett S. [2 ]
Pino, Robinson E. [3 ]
机构
[1] Rochester Inst Technol, Dept Comp Engn, Nanocomp Res Lab, Rochester, NY 14623 USA
[2] RITA, Air Force Res Lab, Trusted Syst Branch, Rome, NY 13441 USA
[3] ICF Int, Fairfax, VA 22031 USA
关键词
Neuromorphic; stochastic gradient descent; memristors; OCR; reconfigurable logic; neural networks; RECOGNITION; NETWORK;
D O I
10.1109/TC.2013.75
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural logic blocks (NLBs) enable the realization of biologically inspired reconfigurable hardware. Networks of NLBs can be trained to perform complex computations such as multilevel Boolean logic and optical character recognition (OCR) in an area-and energy-efficient manner. Recently, several groups have proposed perceptron-based NLB designs with thin-film memristor synapses. These designs are implemented using a static threshold activation function, limiting the set of learnable functions to be linearly separable. In this work, we propose two NLB designs-robust adaptive NLB (RANLB) and multithreshold NLB (MTNLB)-which overcome this limitation by allowing the effective activation function to be adapted during the training process. Consequently, both designs enable any logic function to be implemented in a single-layer NLB network. The proposed NLBs are designed, simulated, and trained to implement ISCAS-85 benchmark circuits, as well as OCR. The MTNLB achieves 90 percent improvement in the energy delay product (EDP) over lookup table (LUT)-based implementations of the ISCAS-85 benchmarks and up to a 99 percent improvement over a previous NLB implementation. As a compromise, the RANLB provides a smaller EDP improvement, but has an average training time of only approximate to 4 cycles for 4-input logic functions, compared to the MTNLBs approximate to 8-cycle average training time.
引用
收藏
页码:1597 / 1606
页数:10
相关论文
共 50 条
  • [41] A Memristor-Based Neural Network Design for Associative Learning
    Wang, Siqi
    Dong, Boyi
    Fu, Yaoyao
    He, Yuhui
    Miao, Xiangshui
    2021 5TH IEEE ELECTRON DEVICES TECHNOLOGY & MANUFACTURING CONFERENCE (EDTM), 2021,
  • [42] Text classification in memristor-based spiking neural networks
    Huang, Jinqi
    Serb, Alexantrou
    Stathopoulos, Spyros
    Prodromakis, Themis
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (01):
  • [43] Equilibrium Propagation and (Memristor-based) Oscillatory Neural Networks
    Zoppo, Gianluca
    Marrone, Francesco
    Bonnin, Michele
    Corinto, Fernando
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 639 - 643
  • [44] Hardware implementation of memristor-based artificial neural networks
    Aguirre, Fernando
    Sebastian, Abu
    Le Gallo, Manuel
    Song, Wenhao
    Wang, Tong
    Yang, J. Joshua
    Lu, Wei
    Chang, Meng-Fan
    Ielmini, Daniele
    Yang, Yuchao
    Mehonic, Adnan
    Kenyon, Anthony
    Villena, Marco A.
    Roldan, Juan B.
    Wu, Yuting
    Hsu, Hung-Hsi
    Raghavan, Nagarajan
    Sune, Jordi
    Miranda, Enrique
    Eltawil, Ahmed
    Setti, Gianluca
    Smagulova, Kamilya
    Salama, Khaled N.
    Krestinskaya, Olga
    Yan, Xiaobing
    Ang, Kah-Wee
    Jain, Samarth
    Li, Sifan
    Alharbi, Osamah
    Pazos, Sebastian
    Lanza, Mario
    NATURE COMMUNICATIONS, 2024, 15 (01)
  • [45] Chimera in a network of memristor-based Hopfield neural network
    Fatemeh Parastesh
    Sajad Jafari
    Hamed Azarnoush
    Boshra Hatef
    Hamidreza Namazi
    Dawid Dudkowski
    The European Physical Journal Special Topics, 2019, 228 : 2023 - 2033
  • [46] Hardware implementation of memristor-based artificial neural networks
    Fernando Aguirre
    Abu Sebastian
    Manuel Le Gallo
    Wenhao Song
    Tong Wang
    J. Joshua Yang
    Wei Lu
    Meng-Fan Chang
    Daniele Ielmini
    Yuchao Yang
    Adnan Mehonic
    Anthony Kenyon
    Marco A. Villena
    Juan B. Roldán
    Yuting Wu
    Hung-Hsi Hsu
    Nagarajan Raghavan
    Jordi Suñé
    Enrique Miranda
    Ahmed Eltawil
    Gianluca Setti
    Kamilya Smagulova
    Khaled N. Salama
    Olga Krestinskaya
    Xiaobing Yan
    Kah-Wee Ang
    Samarth Jain
    Sifan Li
    Osamah Alharbi
    Sebastian Pazos
    Mario Lanza
    Nature Communications, 15
  • [47] Memristor-based chaotic neural networks for associative memory
    Shukai Duan
    Yi Zhang
    Xiaofang Hu
    Lidan Wang
    Chuandong Li
    Neural Computing and Applications, 2014, 25 : 1437 - 1445
  • [48] A Modified Tantalum Oxide Memristor Model for Neural Networks with Memristor-Based Synapses
    Mladenov, Valeri
    2020 9TH INTERNATIONAL CONFERENCE ON MODERN CIRCUITS AND SYSTEMS TECHNOLOGIES (MOCAST), 2020,
  • [49] Memristor-Based Circuit Design for Multilayer Neural Networks
    Zhang, Yang
    Wang, Xiaoping
    Friedman, Eby G.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2018, 65 (02) : 677 - 686
  • [50] Memristor-based chaotic neural networks for associative memory
    Duan, Shukai
    Zhang, Yi
    Hu, Xiaofang
    Wang, Lidan
    Li, Chuandong
    NEURAL COMPUTING & APPLICATIONS, 2014, 25 (06): : 1437 - 1445