VARIATIONAL BAYES AND LOCALIZED FEATURE SELECTION FOR STUDENT'S t-MIXTURE MODELS

被引:2
|
作者
Zhang, Hui [1 ,2 ,3 ]
Wu, Q. M. Jonathan [2 ]
Thanh Minh Nguyen [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing, Peoples R China
[2] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[3] Nanjing Univ Informat Sci & Technol, Jiangsu Engn Ctr Network Monitoring, Nanjing, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Bayesian approach; feature selection; Student's t-distributions; variational learning; RECOGNITION; INFERENCE;
D O I
10.1142/S021800141350016X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel algorithm for feature selection and model detection using Student's t-distribution based on the variational Bayesian (VB) approach. First, our method is based on the Student's t-mixture model (SMM) which has heavier tail than the Gaussian distribution and is therefore less sensitive to small numbers of data points and consequent precision-estimates of the components number. Second, the number of components, the local feature saliency and the parameters of the mixture model are simultaneously estimated by Bayesian variational learning. Experimental results using synthetic and real data demonstrate the improved robustness of our approach.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Testing Homogeneity for Normal Mixture Models: Variational Bayes Approach
    Kariya, Natsuki
    Watanabe, Sumio
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2020, E103A (11) : 1274 - 1282
  • [22] A VQ DIGITAL WATERMARK ALGORITHM BASED ON T-MIXTURE MODELS SEGMENTATION
    Luo, Bin
    Gu, Wei
    Guo, Hui
    2008 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND SIGNAL PROCESSING, VOLS 1 AND 2, 2007, : 353 - +
  • [23] An Online Approach for Learning Non-Gaussian Mixture Models with Localized Feature Selection
    Fan, Wentao
    Bouguila, Nizar
    2013 FIRST INTERNATIONAL CONFERENCE ON COMMUNICATIONS SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA'13), 2013,
  • [24] Coronary Artery Stenosis Quantification for Computed Tomography Angiography Based on Modified Student's t-Mixture Model
    Sun, Qiaoyu
    Yang, Guanyu
    Shu, Huazhong
    Shi, Daming
    ETRI JOURNAL, 2017, 39 (05) : 662 - 671
  • [25] A Block EM Algorithm for Multivariate Skew Normal and Skew t-Mixture Models
    Lee, Sharon X.
    Leemaqz, Kaleb L.
    McLachlan, Geoffrey J.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5581 - 5591
  • [26] A Student t-mixture autoregressive model with applications to heavy-tailed financial data
    Wong, C. S.
    Chan, W. S.
    Kam, P. L.
    BIOMETRIKA, 2009, 96 (03) : 751 - 760
  • [27] Model selection for the localized mixture of experts models
    Jiang, Yunlu
    Yu Conglian
    Ji Qinghua
    JOURNAL OF APPLIED STATISTICS, 2018, 45 (11) : 1994 - 2006
  • [28] Joint and conditional transformed t-mixture models with applications to financial and economic data
    Friedman, Craig
    Cao, Wenbo
    Huang, Jinggang
    Zhang, Yangyong
    JOURNAL OF RISK, 2009, 11 (03): : 25 - 54
  • [29] Parsimonious reduction of Gaussian mixture models with a variational-Bayes approach
    Bruneau, Pierrick
    Gelgon, Marc
    Picarougne, Fabien
    PATTERN RECOGNITION, 2010, 43 (03) : 850 - 858
  • [30] Localized Feature Selection for Gaussian Mixtures Using Variational Learning
    Li, Yuanhong
    Dong, Ming
    Ma, Yunqian
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 2974 - 2977