Biologically plausible single-layer networks for nonnegative independent component analysis

被引:3
|
作者
Lipshutz, David [1 ]
Pehlevan, Cengiz [2 ]
Chklovskii, Dmitri B. [1 ,3 ]
机构
[1] Flatiron Inst, Ctr Computat Neurosci, New York, NY 10010 USA
[2] Harvard Univ, John A Paulson Sch Engn & Appl Sci, Cambridge, MA 02138 USA
[3] NYU Med Ctr, Neurosci Inst, New York, NY 10016 USA
关键词
Blind source separation; Nonnegative independent component analysis; Neural network; Local learning rules; COCKTAIL-PARTY PROBLEM; MATRIX FACTORIZATION; SEPARATION; ALGORITHMS; DECOMPOSITION;
D O I
10.1007/s00422-022-00943-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
An important problem in neuroscience is to understand how brains extract relevant signals from mixtures of unknown sources, i.e., perform blind source separation. To model how the brain performs this task, we seek a biologically plausible single-layer neural network implementation of a blind source separation algorithm. For biological plausibility, we require the network to satisfy the following three basic properties of neuronal circuits: (i) the network operates in the online setting; (ii) synaptic learning rules are local; and (iii) neuronal outputs are nonnegative. Closest is the work by Pehlevan et al. (Neural Comput 29:2925-2954, 2017), which considers nonnegative independent component analysis (NICA), a special case of blind source separation that assumes the mixture is a linear combination of uncorrelated, nonnegative sources. They derive an algorithm with a biologically plausible 2-layer network implementation. In this work, we improve upon their result by deriving 2 algorithms for NICA, each with a biologically plausible single-layer network implementation. The first algorithm maps onto a network with indirect lateral connections mediated by interneurons. The second algorithm maps onto a network with direct lateral connections and multi-compartmental output neurons.
引用
收藏
页码:557 / 568
页数:12
相关论文
共 50 条
  • [41] A Hybrid Constructive Algorithm for Single-Layer Feedforward Networks Learning
    Wu, Xing
    Rozycki, Pawel
    Wilamowski, Bogdan M.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (08) : 1659 - 1668
  • [42] Serving Multicast Requests on Single-Layer and Multilayer Flexgrid Networks
    Ruiz, Marc
    Velasco, Luis
    JOURNAL OF OPTICAL COMMUNICATIONS AND NETWORKING, 2015, 7 (03) : 146 - 155
  • [43] Nonnegative independent component analysis based on minimizing. mutual information technique
    Zheng, CH
    Huang, DS
    Sun, ZL
    Lyu, MR
    Lok, TM
    NEUROCOMPUTING, 2006, 69 (7-9) : 878 - 883
  • [44] Impact of Layer Normalization on Single-Layer Perceptron - Statistical Mechanical Analysis
    Takagi, Shiro
    Yoshida, Yuki
    Okada, Masato
    JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 2019, 88 (07)
  • [45] Design and analysis of a single-layer slotted waveguide array
    Coetzee, JC
    Xu, HY
    MICROWAVE AND OPTICAL TECHNOLOGY LETTERS, 2000, 27 (06) : 379 - 382
  • [46] Nonlinear vibrational analysis of single-layer graphene sheets
    Sadeghi, M.
    Naghdabadi, R.
    NANOTECHNOLOGY, 2010, 21 (10)
  • [47] Analysis of single-layer metamaterial absorber with reflection theory
    Xiong, Han
    Tang, Ming-Chun
    Hong, Jing-Song
    JOURNAL OF APPLIED PHYSICS, 2015, 117 (15)
  • [48] Analysis of a Single-Layer Thermophotovoltaic System at Moderate Temperatures
    Shi, Linda Z.
    Xu, Spencer Y.
    Boehm, R.F.
    Journal of Thermophysics and Heat Transfer, 2001, 15 (1-4) : 453 - 457
  • [49] A class of neural networks for independent component analysis
    Karhunen, J
    Oja, E
    Wang, LY
    Vigario, R
    Joutsensalo, J
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (03): : 486 - 504
  • [50] Independent component analysis by evolutionary neural networks
    Chen, YW
    Zeng, XY
    Nakao, Z
    Yamashita, K
    APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN IMAGE PROCESSING V, 2000, 3962 : 83 - 90