Variational bayesian feature selection for Gaussian mixture models

In this paper we show that feature selection problem can be formulated as a model selection problem. A Bayesian framework for feature selection in unsupervised learning based on Gaussian Mixture Models is applied to speech recognition. In the original formulation (see [1]) a Minimum MessageLength criterion is used for model selection; we propose a new model selection technique based on Variational Bayesian Learning that shows a higher robustness to amount of training data. Results on speech data from the TIMIT database show a high efficiency in determining feature saliency.