FPGA Implementation for Large Scale Reservoir Computing based on Chaotic Boltzmann Machine

被引:0
|
作者
Matsumoto, Shigeki [1 ]
Ichikawa, Yuki [1 ]
Kajihara, Nobuki [1 ]
Tamukoh, Hakaru [2 ]
机构
[1] IVIS Inc, Bunkyo ku, Tokyo, Japan
[2] Kyushu Inst Technol, Graduate Sch Life Sci & Syst Engn, Kitakyushu, Japan
关键词
Neural networks; Reservoir Computing; FPGA; Chaotic Boltzmann Machine; Sparse Matrix Compression;
D O I
10.1109/ISCAS58744.2024.10558106
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper reports on a field programmable gate array (FPGA) implementation of Chaotic Boltzmann Machine Reservoir Computing (CBM-RC). The reservoir will be large-scale, as it is expected to be applied to sensor information prediction for autonomous mobile robots. Therefore, we employ a design premised on storing the weight information into a large memory outside the FPGA. We propose an efficient compression method for the weight matrix and a parallel processing system, by considering both the characteristics of CBM-RC and the fact that the weight matrix of a large-scale reservoir is generally a sparse matrix. Our RC system, which has more than 8000 neurons and 1024 inputs/outputs, has been implemented on an AMD Alveo U50 FPGA board. This RC is the largest scale compared to those in related studies. We have performed the NARMA10 task and demonstrated that we can estimate 1024 predictions at once with NMSE accuracy that is even or better to conventional RC.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] FPGA Implementation of a Chaotic Boltzmann Machine Annealer
    Yoshioka, Kanta
    Katori, Yuichi
    Tanaka, Yuichiro
    Nomura, Osamu
    Morie, Takashi
    Tamukoh, Hakaru
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] A Chaotic Boltzmann Machine Working as a Reservoir and Its Analog VLSI Implementation
    Yamaguchi, Masatoshi
    Katori, Yuichi
    Kamimura, Daichi
    Tamukoh, Hakaru
    Morie, Takashi
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [3] Large-Scale Optical Reservoir Computing for Spatiotemporal Chaotic Systems Prediction
    Rafayelyan, Mushegh
    Dong, Jonathan
    Tan, Yongqi
    Krzakala, Florent
    Gigane, Sylvain
    PHYSICAL REVIEW X, 2020, 10 (04):
  • [4] FPGA Implementation of Hardware-Oriented Chaotic Boltzmann Machines
    Kawashima, Ichiro
    Morie, Takashi
    Tamukoh, Hakaru
    IEEE ACCESS, 2020, 8 : 204360 - 204377
  • [5] A HIGHLY SCALABLE RESTRICTED BOLTZMANN MACHINE FPGA IMPLEMENTATION
    Kim, Sang Kyun
    McAfee, Lawrence C.
    McMahon, Peter L.
    Olukotun, Kunle
    FPL: 2009 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS, 2009, : 367 - 372
  • [6] Traffic Flow Optimization using a Chaotic Boltzmann Machine Annealer on an FPGA
    Yoshioka, Kanta
    Tanaka, Yuichiro
    Tamukoh, Hakaru
    Proceedings - International Conference on Field-Programmable Technology, ICFPT, 2023, : 266 - 267
  • [7] Traffic Flow Optimization using a Chaotic Boltzmann Machine Annealer on an FPGA
    Yoshioka, Kanta
    Tanaka, Yuichiro
    Tamukoh, Hakaru
    2023 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE TECHNOLOGY, ICFPT, 2023, : 266 - 269
  • [8] Neuromorphic Analog Implementation of Reservoir Computing for Machine Learning
    Hazan, Avi
    Tsur, Elishai Ezra
    2022 29TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (IEEE ICECS 2022), 2022,
  • [9] LARGE-SCALE COMPUTING IN RESERVOIR SIMULATION
    EWING, RE
    INTERNATIONAL JOURNAL OF SUPERCOMPUTER APPLICATIONS AND HIGH PERFORMANCE COMPUTING, 1988, 2 (04): : 45 - 53
  • [10] FPGA-based Reservoir Computing with Optimized Reservoir Node Architecture
    Lin, Chunxiao
    Liang, Yibin
    Yi, Yang
    PROCEEDINGS OF THE TWENTY THIRD INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2022), 2022, : 325 - 330