Biologically plausible single-layer networks for nonnegative independent component analysis

被引:3
|
作者
Lipshutz, David [1 ]
Pehlevan, Cengiz [2 ]
Chklovskii, Dmitri B. [1 ,3 ]
机构
[1] Flatiron Inst, Ctr Computat Neurosci, New York, NY 10010 USA
[2] Harvard Univ, John A Paulson Sch Engn & Appl Sci, Cambridge, MA 02138 USA
[3] NYU Med Ctr, Neurosci Inst, New York, NY 10016 USA
关键词
Blind source separation; Nonnegative independent component analysis; Neural network; Local learning rules; COCKTAIL-PARTY PROBLEM; MATRIX FACTORIZATION; SEPARATION; ALGORITHMS; DECOMPOSITION;
D O I
10.1007/s00422-022-00943-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
An important problem in neuroscience is to understand how brains extract relevant signals from mixtures of unknown sources, i.e., perform blind source separation. To model how the brain performs this task, we seek a biologically plausible single-layer neural network implementation of a blind source separation algorithm. For biological plausibility, we require the network to satisfy the following three basic properties of neuronal circuits: (i) the network operates in the online setting; (ii) synaptic learning rules are local; and (iii) neuronal outputs are nonnegative. Closest is the work by Pehlevan et al. (Neural Comput 29:2925-2954, 2017), which considers nonnegative independent component analysis (NICA), a special case of blind source separation that assumes the mixture is a linear combination of uncorrelated, nonnegative sources. They derive an algorithm with a biologically plausible 2-layer network implementation. In this work, we improve upon their result by deriving 2 algorithms for NICA, each with a biologically plausible single-layer network implementation. The first algorithm maps onto a network with indirect lateral connections mediated by interneurons. The second algorithm maps onto a network with direct lateral connections and multi-compartmental output neurons.
引用
收藏
页码:557 / 568
页数:12
相关论文
共 50 条
  • [1] Biologically plausible single-layer networks for nonnegative independent component analysis
    David Lipshutz
    Cengiz Pehlevan
    Dmitri B. Chklovskii
    Biological Cybernetics, 2022, 116 : 557 - 568
  • [2] A Normative and Biologically Plausible Algorithm for Independent Component Analysis
    Bahroun, Yanis
    Chklovskii, Dmitri B.
    Sengupta, Anirvan M.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] Conditions for nonnegative independent component analysis
    Plumbley, M
    IEEE SIGNAL PROCESSING LETTERS, 2002, 9 (06) : 177 - 180
  • [4] Algorithms for nonnegative independent component analysis
    Plumbley, MD
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (03): : 534 - 543
  • [5] Nonnegative Compression for Semi-Nonnegative Independent Component Analysis
    Wang, Lu
    Kachenoura, Amar
    Albera, Laurent
    Karfoul, Ahmad
    Shu, Hua Zhong
    Senhadji, Lotti
    2014 IEEE 8TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2014, : 81 - 84
  • [6] Improved algorithm for nonnegative independent component analysis
    Zhou, Hao
    Wang, Bin
    Zhang, Liming
    Shuju Caiji Yu Chuli/Journal of Data Acquisition and Processing, 2007, 22 (01): : 54 - 58
  • [7] Nonnegative matrix factorization for independent component analysis
    Yang, Shangming
    Zhang, Yi
    2007 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS PROCEEDINGS, VOLS 1 AND 2: VOL 1: COMMUNICATION THEORY AND SYSTEMS; VOL 2: SIGNAL PROCESSING, COMPUTATIONAL INTELLIGENCE, CIRCUITS AND SYSTEMS, 2007, : 769 - +
  • [8] A "nonnegative PCA" algorithm for independent component analysis
    Plumbley, MD
    Oja, E
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (01): : 66 - 76
  • [9] Gradient algorithm for nonnegative independent component analysis
    Yang, Shangming
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 1115 - 1120
  • [10] Design and analysis of frequency-independent reflectionless single-layer metafilms
    Tamayama, Yasuhiro
    OPTICS LETTERS, 2016, 41 (06) : 1102 - 1105