Learning topographic sparse coding through similarity function

被引:2
|
作者
Zhou, Qi [1 ]
Zhang, Liqing [1 ]
Ma, Libo [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
关键词
D O I
10.1109/ICNC.2008.139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a novel method to learn the topographic and sparse representation from the natural images. By using two kinds of similarity, functions onto the sparse coding bases learned from natural images respectively, we find that these Gabor-like bases inherently contain the topographic information. This method makes those similar bases be close to each other and a topographic organization emerged in the 2-D space. These two kinds of similarity functions are: basis functions similarity in classical sparse model [7] and analysis vectors similarity in encoder/decoder model [2]. Traditional topographic ICA [3] and topographic sparse coding [6] that contain two layer network, however our proposed model can generate the topographic visualization by using one layer network. The simulation results demonstrate that these two kinds of similarity functions can produce distinct topographic organization of bases, and the analysis vectors similarity provides better results.
引用
收藏
页码:241 / 245
页数:5
相关论文
共 50 条
  • [21] Learning step sizes for unfolded sparse coding
    Ablin, Pierre
    Moreau, Thomas
    Massias, Mathurin
    Gramfort, Alexandre
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [22] DICTIONARY LEARNING AND SPARSE CODING FOR UNSUPERVISED CLUSTERING
    Sprechmann, Pablo
    Sapiro, Guillermo
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 2042 - 2045
  • [23] Online learning for matrix factorization and sparse coding
    Mairal, Julien
    Bach, Francis
    Ponce, Jean
    Sapiro, Guillermo
    Journal of Machine Learning Research, 2010, 11 : 19 - 60
  • [24] Confident Kernel Sparse Coding and Dictionary Learning
    Hosseini, K.
    Hammer, Barbara
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 1031 - 1036
  • [25] Learning Word Representations with Hierarchical Sparse Coding
    Yogatama, Dani
    Faruqui, Manaal
    Dyer, Chris
    Smith, Noah A.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 87 - 96
  • [26] Online Learning for Matrix Factorization and Sparse Coding
    Mairal, Julien
    Bach, Francis
    Ponce, Jean
    Sapiro, Guillermo
    JOURNAL OF MACHINE LEARNING RESEARCH, 2010, 11 : 19 - 60
  • [27] Linking Sparse Coding Dictionaries for Representation Learning
    Barari, Nicki
    Kim, Edward
    2021 INTERNATIONAL CONFERENCE ON REBOOTING COMPUTING (ICRC 2021), 2021, : 84 - 87
  • [28] Learning Ancestral Atom via Sparse Coding
    Aritake, Toshimitsu
    Hino, Hideitsu
    Murata, Noboru
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2013, 7 (04) : 586 - 594
  • [29] An MDL Framework for Sparse Coding and Dictionary Learning
    Ramirez, Ignacio
    Sapiro, Guillermo
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (06) : 2913 - 2927
  • [30] Sparse coding extreme learning machine for classification
    Yu, Yuanlong
    Sun, Zhenzhen
    NEUROCOMPUTING, 2017, 261 : 50 - 56