VARIATIONAL BAYES AND LOCALIZED FEATURE SELECTION FOR STUDENT'S t-MIXTURE MODELS

被引:2
|
作者
Zhang, Hui [1 ,2 ,3 ]
Wu, Q. M. Jonathan [2 ]
Thanh Minh Nguyen [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing, Peoples R China
[2] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[3] Nanjing Univ Informat Sci & Technol, Jiangsu Engn Ctr Network Monitoring, Nanjing, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Bayesian approach; feature selection; Student's t-distributions; variational learning; RECOGNITION; INFERENCE;
D O I
10.1142/S021800141350016X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel algorithm for feature selection and model detection using Student's t-distribution based on the variational Bayesian (VB) approach. First, our method is based on the Student's t-mixture model (SMM) which has heavier tail than the Gaussian distribution and is therefore less sensitive to small numbers of data points and consequent precision-estimates of the components number. Second, the number of components, the local feature saliency and the parameters of the mixture model are simultaneously estimated by Bayesian variational learning. Experimental results using synthetic and real data demonstrate the improved robustness of our approach.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Auto clustering method study of flow cytometry data based on skew t-mixture models
    Wang, Xian-Wen
    Chen, Feng
    Cheng, Zhi
    Du, Yao-Hua
    Bao, Hong-Tao
    Wu, Tai-Hu
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2014, 42 (12): : 2527 - 2535
  • [42] Finite mixtures of canonical fundamental skew t-distributions The unification of the restricted and unrestricted skew t-mixture models
    Lee, Sharon X.
    McLachlan, Geoffrey J.
    STATISTICS AND COMPUTING, 2016, 26 (03) : 573 - 589
  • [43] Unsupervised Image Categorization Based on Variational Autoencoder and Student's-T Mixture Model
    Zhang, Yu
    Fan, Wentao
    Bouguila, Nizar
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2403 - 2409
  • [44] MULTIVIEW DEPTH MAP ENHANCEMENT BY VARIATIONAL BAYES INFERENCE ESTIMATION OF DIRICHLET MIXTURE MODELS
    Rana, Pravin Kumar
    Ma, Zhanyu
    Taghia, Jalil
    Flierl, Markus
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 1528 - 1532
  • [45] Parameter-based reduction of Gaussian mixture models with a variational-Bayes approach
    Bruneau, Pierrick
    Gelgon, Marc
    Picarougne, Fabien
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 144 - 147
  • [46] Student's t mixture models for stock indices. A comparative study
    Massing, Till
    Ramos, Arturo
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2021, 580
  • [47] Variational inference for Student-t MLP models
    Nguyen, Hang T.
    Nabney, Ian T.
    NEUROCOMPUTING, 2010, 73 (16-18) : 2989 - 2997
  • [48] Variational Deep Embedding with Regularized Student-t Mixture Model
    Kobayashi, Taisuke
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: IMAGE PROCESSING, PT III, 2019, 11729 : 443 - 455
  • [49] GAUSSIAN AND STUDENT-T FILTERING USING IMPLICIT MEASUREMENTS VIA VARIATIONAL BAYES
    Tapia, Ernesto
    2014 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2014,
  • [50] Robust inferential sensor development based on variational Bayesian Student's-t mixture regression
    Wang, Jingbo
    Shao, Weiming
    Song, Zhihuan
    NEUROCOMPUTING, 2019, 369 : 11 - 28