Biological neurons act as generalization filters in reservoir computing

被引:11
|
作者
Sumi, Takuma [1 ,2 ]
Yamamoto, Hideaki [1 ,3 ]
Katori, Yuichi [4 ,5 ]
Ito, Koki [1 ,3 ]
Moriya, Satoshi [1 ]
Konno, Tomohiro [6 ]
Sato, Shigeo [1 ,3 ]
Hirano-Iwata, Ayumi [1 ,2 ,3 ,7 ]
机构
[1] Tohoku Univ, Res Inst Elect Commun, Sendai 9808577, Japan
[2] Tohoku Univ, Grad Sch Biomed Engn, Sendai 9808579, Japan
[3] Tohoku Univ, Sch Engn, Sendai 9808579, Japan
[4] Future Univ Hakodate, Grad Sch Syst Informat Sci, Hakodate 0418655, Japan
[5] Univ Tokyo, Inst Ind Sci, Tokyo 1538505, Japan
[6] Tohoku Univ, Grad Sch Pharmaceut Sci, Sendai 9808578, Japan
[7] Tohoku Univ, Adv Inst Mat Res, World Premier Int Res Ctr Initiat, Sendai 9808577, Japan
基金
日本科学技术振兴机构;
关键词
machine; biological computing; neuronal networks; bioengineering; optogenetics; PATTERN-RECOGNITION; NEURAL-NETWORK; DYNAMICS; MEMORY; COMPUTATION; SEQUENCES; PROPERTY; EVENTS;
D O I
10.1073/pnas.2217008120
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Reservoir computing is a machine learning paradigm that transforms the transient dynamics of high-dimensional nonlinear systems for processing time-series data. Although the paradigm was initially proposed to model information processing in the mammalian cortex, it remains unclear how the nonrandom network architecture, such as the modular architecture, in the cortex integrates with the biophysics of living neu-rons to characterize the function of biological neuronal networks (BNNs). Here, we used optogenetics and calcium imaging to record the multicellular responses of cultured BNNs and employed the reservoir computing framework to decode their computational capabilities. Micropatterned substrates were used to embed the modular architecture in the BNNs. We first show that the dynamics of modular BNNs in response to static inputs can be classified with a linear decoder and that the modularity of the BNNs positively correlates with the classification accuracy. We then used a timer task to verify that BNNs possess a short -term memory of several 100 ms and finally show that this property can be exploited for spoken digit classification. Interestingly, BNN- based reservoirs allow categorical learning, wherein a network trained on one dataset can be used to classify separate datasets of the same category. Such classification was not possible when the inputs were directly decoded by a linear decoder, suggesting that BNNs act as a gen-eralization filter to improve reservoir computing performance. Our findings pave the way toward a mechanistic understanding of information representation within BNNs and build future expectations toward the realization of physical reservoir computing systems based on BNNs.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] A tighter generalization bound for reservoir computing
    Han, Xinyu
    Zhao, Yi
    Small, Michael
    CHAOS, 2022, 32 (04)
  • [2] Reservoir Computing based Neural Image Filters
    Ganguly, Samiran
    Gu, Yunfei
    Xie, Yunkun
    Stan, Mircea R.
    Ghosh, Avik W.
    Dhar, Nibir K.
    IECON 2018 - 44TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2018, : 3206 - 3210
  • [3] Similarity Learning and Generalization with Limited Data: A Reservoir Computing Approach
    Krishnagopal, Sanjukta
    Alohnonos, Yiannis
    Girvan, Michelle
    COMPLEXITY, 2018,
  • [4] Reservoir computing methods for functional identification of biological networks
    Tayfun Gürelu
    Stefan Rotter
    Ulrich Egert
    BMC Neuroscience, 10 (Suppl 1)
  • [5] Connectivity, Dynamics, and Memory in Reservoir Computing with Binary and Analog Neurons
    Buesing, Lars
    Schrauwen, Benjamin
    Legenstein, Robert
    NEURAL COMPUTATION, 2010, 22 (05) : 1272 - 1311
  • [6] SEDIMENT-ASSOCIATED MACROALGAE ACT AS BIOLOGICAL FILTERS IN ESTUARIES
    DAVIS, MW
    ZIMMERMAN, C
    MONTGOMERY, J
    ESTUARIES, 1983, 6 (03): : 312 - 312
  • [7] Rotating neurons for all-analog implementation of cyclic reservoir computing
    Xiangpeng Liang
    Yanan Zhong
    Jianshi Tang
    Zhengwu Liu
    Peng Yao
    Keyang Sun
    Qingtian Zhang
    Bin Gao
    Hadi Heidari
    He Qian
    Huaqiang Wu
    Nature Communications, 13
  • [8] Product Reservoir Computing: Time-Series Computation with Multiplicative Neurons
    Goudarzi, Alireza
    Shabani, Alireza
    Stefanovic, Darko
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [9] Collective dynamics of rate neurons for supervised learning in a reservoir computing system
    Maslennikova, Oleg V.
    Nekorkin, Vladimir I.
    CHAOS, 2019, 29 (10)
  • [10] Rotating neurons for all-analog implementation of cyclic reservoir computing
    Liang, Xiangpeng
    Zhong, Yanan
    Tang, Jianshi
    Liu, Zhengwu
    Yao, Peng
    Sun, Keyang
    Zhang, Qingtian
    Gao, Bin
    Heidari, Hadi
    Qian, He
    Wu, Huaqiang
    NATURE COMMUNICATIONS, 2022, 13 (01)