VARIATIONAL BAYES AND LOCALIZED FEATURE SELECTION FOR STUDENT'S t-MIXTURE MODELS

被引:2
|
作者
Zhang, Hui [1 ,2 ,3 ]
Wu, Q. M. Jonathan [2 ]
Thanh Minh Nguyen [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing, Peoples R China
[2] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[3] Nanjing Univ Informat Sci & Technol, Jiangsu Engn Ctr Network Monitoring, Nanjing, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Bayesian approach; feature selection; Student's t-distributions; variational learning; RECOGNITION; INFERENCE;
D O I
10.1142/S021800141350016X
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel algorithm for feature selection and model detection using Student's t-distribution based on the variational Bayesian (VB) approach. First, our method is based on the Student's t-mixture model (SMM) which has heavier tail than the Gaussian distribution and is therefore less sensitive to small numbers of data points and consequent precision-estimates of the components number. Second, the number of components, the local feature saliency and the parameters of the mixture model are simultaneously estimated by Bayesian variational learning. Experimental results using synthetic and real data demonstrate the improved robustness of our approach.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] Robust Autoregression: Student-t Innovations Using Variational Bayes
    Christmas, Jacqueline
    Everson, Richard
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (01) : 48 - 57
  • [32] DETECTION AND FEATURE SELECTION IN SPARSE MIXTURE MODELS
    Verzelen, Nicolas
    Arias-Castro, Ery
    ANNALS OF STATISTICS, 2017, 45 (05): : 1920 - 1950
  • [33] A Robust TCPHD Filter for Multi-Sensor Multitarget Tracking Based on a Gaussian-Student's t-Mixture Model
    Wei, Shaoming
    Lin, Yingbin
    Wang, Jun
    Zeng, Yajun
    Qu, Fangrui
    Zhou, Xuan
    Lu, Zhuotong
    REMOTE SENSING, 2024, 16 (03)
  • [34] Unsupervised Variational Learning of Finite Generalized Inverted Dirichlet Mixture Models with Feature Selection and Component Splitting
    Maanicshah, Kamal
    Ali, Samr
    Fan, Wentao
    Bouguila, Nizar
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2019), PT II, 2019, 11663 : 94 - 105
  • [35] Content-based image retrieval using student’s t-mixture model and constrained multiview nonnegative matrix factorization
    Hongqing Zhu
    Qunyi Xie
    Multimedia Tools and Applications, 2018, 77 : 14207 - 14239
  • [36] Lower bounds of Stochastic complexities in variational Bayes learning of Gaussian mixture models
    Watanabe, K
    Watanabe, S
    2004 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2004, : 99 - 104
  • [37] Content-based image retrieval using student's t-mixture model and constrained multiview nonnegative matrix factorization
    Zhu, Hongqing
    Xie, Qunyi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (11) : 14207 - 14239
  • [38] The Feature selection and Comparison performance of Student's academic between Random Forest, Naive bayes and XGboost
    Thanarat, Preut
    Kiatjindarat, Waranyoo
    Jareanpon, Chatklaw
    2023 IEEE INTERNATIONAL CONFERENCE ON TEACHING, ASSESSMENT AND LEARNING FOR ENGINEERING, TALE, 2023, : 636 - 641
  • [39] Simultaneous feature selection and clustering using mixture models
    Law, MHC
    Figueiredo, MAT
    Jain, AK
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (09) : 1154 - 1166
  • [40] Bayesian feature and model selection for Gaussian mixture models
    Constantinopoulos, C
    Titsias, MK
    Likas, A
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (06) : 1013 - U1