CSFL: A novel unsupervised convolution neural network approach for visual pattern classification

被引:44
|
作者
Rehman, Sadaqat Ur [1 ]
Tu, Shanshan [2 ]
Huang, Yongfeng [1 ]
Liu, Guojie [2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolution neural network; classification; unsupervised learning; feature extraction; OBJECT RECOGNITION; FEATURES; ALGORITHM; MOTION;
D O I
10.3233/AIC-170739
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancement of technology and expansion of broadcasting around the globe has further boost up biometric surveillance systems. Pattern recognition is the key track in this area. Convolution neural network (CNN) as one of the most prevalent deep learning algorithm has gain high reputation in image features extraction. In this paper, we propose few new twists of unsupervised learning i.e. convolution sparse filter learning (CSFL) to obtain rich and discriminative features of an image. The features extracted by CSFL algorithm are used to initialize the first CNN layer, and then these features are further used in feed forward manner by the CNN to learn high level features for classification. The linear regression classifier (softmax classifier) is used to serve as the output layer of CNN for providing the probability of an image class. We present and examine five different architectures of CNN and error function mean square error (MSE). The experimental results on a public dataset showcase the merit of the proposed method.
引用
收藏
页码:311 / 324
页数:14
相关论文
共 50 条
  • [41] Probabilistic Neural Network for pattern classification
    Patra, PK
    Nayak, M
    Nayak, SK
    Gobbak, NK
    PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, : 1200 - 1205
  • [42] Fuzzy Neural Network for Pattern Classification
    Kulkarni, Arun
    Kulkarni, Nikita
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 2606 - 2616
  • [43] Pattern classification by a condensed neural network
    Mitiche, A
    Lebidoff, M
    NEURAL NETWORKS, 2001, 14 (4-5) : 575 - 580
  • [44] Unsupervised neural network models of the ventral visual stream
    Zhuang, Chengxu
    Yan, Siming
    Nayebi, Aran
    Schrimpf, Martin
    Frank, Michael C.
    DiCarlo, James J.
    Yamins, Daniel L. K.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (03)
  • [45] Unsupervised Learning Approach for Network Traffic Classification
    Abboud, Mario Bou
    Baala, Oumaya
    Drissit, Maroua
    Alliot, Sylvain
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1155 - 1160
  • [46] A Novel Approach for Sentiment Classification by Using Convolutional Neural Network
    Kalaivani, M. S.
    Jayalakshmi, S.
    PROCEEDINGS OF SECOND INTERNATIONAL CONFERENCE ON SUSTAINABLE EXPERT SYSTEMS (ICSES 2021), 2022, 351 : 143 - 152
  • [47] Neural network for visual search classification
    Raju, H
    Hobson, RS
    Wetzel, PA
    PROCEEDINGS OF THE 23RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-4: BUILDING NEW BRIDGES AT THE FRONTIERS OF ENGINEERING AND MEDICINE, 2001, 23 : 2737 - 2739
  • [48] Fully memristive neural networks for pattern classification with unsupervised learning
    Zhongrui Wang
    Saumil Joshi
    Sergey Savel’ev
    Wenhao Song
    Rivu Midya
    Yunning Li
    Mingyi Rao
    Peng Yan
    Shiva Asapu
    Ye Zhuo
    Hao Jiang
    Peng Lin
    Can Li
    Jung Ho Yoon
    Navnidhi K. Upadhyay
    Jiaming Zhang
    Miao Hu
    John Paul Strachan
    Mark Barnell
    Qing Wu
    Huaqiang Wu
    R. Stanley Williams
    Qiangfei Xia
    J. Joshua Yang
    Nature Electronics, 2018, 1 : 137 - 145
  • [49] Fully memristive neural networks for pattern classification with unsupervised learning
    Wang, Zhongrui
    Joshi, Saumil
    Savel'ev, Sergey
    Song, Wenhao
    Midya, Rivu
    Li, Yunning
    Rao, Mingyi
    Yan, Peng
    Asapu, Shiva
    Zhuo, Ye
    Jiang, Hao
    Lin, Peng
    Li, Can
    Yoon, Jung Ho
    Upadhyay, Navnidhi K.
    Zhang, Jiaming
    Hu, Miao
    Strachan, John Paul
    Barnell, Mark
    Wu, Qing
    Wu, Huaqiang
    Williams, R. Stanley
    Xia, Qiangfei
    Yang, J. Joshua
    NATURE ELECTRONICS, 2018, 1 (02): : 137 - 145
  • [50] Unsupervised learning of neural network ensembles for image classification
    Giacinto, G
    Roli, F
    Fumera, G
    IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL III, 2000, : 155 - 159