Image classification with deep belief networks and improved gradient descent

被引:5
|
作者
Liu, Gang [1 ]
Xiao, Liang [1 ]
Xiong, Caiquan [1 ]
机构
[1] Hubei Univ Technol, Sch Comp Sci, Wuhan, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
MACHINE;
D O I
10.1109/CSE-EUC.2017.74
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Image classification mainly uses the classifier to classify the extracted image features. In the traditional image feature extraction, it is difficult to set the appropriate feature patterns for the complex images. Simultaneously, the training algorithm of the classifier also affects the accuracy of image classification. In order to solve these problems, the combination of deep belief networks and the classifier is used for image classification. In the new image classification method, an improved gradient descent method is proposed to train the classifier. Restricted boltzmann machines can be stacked and trained in a greedy manner to form deep belief networks. The deep belief networks are used to extract the features of images and the classifier is used to classify these feature vectors. Compared with other depth learning methods to extract the image features, the deep belief networks can recover the original image using the feature vectors and can guarantee the correctness of the extracted features. Experimental verifications are conducted on MNIST dataset. Experimental results indicate that compared with other classifiers, our approach can get the higher classification accuracy in less time and have superior anti-overfitting ability.
引用
收藏
页码:375 / 380
页数:6
相关论文
共 50 条
  • [21] Learning dynamics of gradient descent optimization in deep neural networks
    Wu, Wei
    Jing, Xiaoyuan
    Du, Wencai
    Chen, Guoliang
    SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (05)
  • [22] A DIVERSIFIED DEEP BELIEF NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhong, P.
    Gong, Z. Q.
    Schonlieb, C.
    XXIII ISPRS CONGRESS, COMMISSION VII, 2016, 41 (B7): : 443 - 449
  • [23] Gradient Descent Finds Global Minima of Deep Neural Networks
    Du, Simon S.
    Lee, Jason D.
    Li, Haochuan
    Wang, Liwei
    Zhai, Xiyu
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [24] Learning dynamics of gradient descent optimization in deep neural networks
    Wei Wu
    Xiaoyuan Jing
    Wencai Du
    Guoliang Chen
    Science China Information Sciences, 2021, 64
  • [25] Global Convergence of Gradient Descent for Deep Linear Residual Networks
    Wu, Lei
    Wang, Qingcan
    Ma, Chao
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [26] Evolutionary Stochastic Gradient Descent for Optimization of Deep Neural Networks
    Cui, Xiaodong
    Zhang, Wei
    Tuske, Zoltan
    Picheny, Michael
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [27] Application of Alternating Deep Belief Network in Image Classification
    Shi, Tao
    Zhang, Chunlei
    Li, Fujin
    Liu, Weimin
    Huo, Meijie
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 1853 - 1856
  • [28] Learning dynamics of gradient descent optimization in deep neural networks
    Wei WU
    Xiaoyuan JING
    Wencai DU
    Guoliang CHEN
    ScienceChina(InformationSciences), 2021, 64 (05) : 17 - 31
  • [29] Improved Color Scene Classification System using Deep Belief Networks and Support Vector Machines
    Sowmya, V.
    Ajay, Aleena
    Govind, D.
    Soman, K. P.
    2017 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (ICSIPA), 2017, : 33 - 38
  • [30] Image Blur Classification and Parameter Identification using Two-stage Deep Belief Networks
    Yan, Ruomei
    Shao, Ling
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,