A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:44
|
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [41] Image recognition based on hidden Markov eigen-image models using variational Bayesian method
    Sawada, Kei
    Hashimoto, Kei
    Nankaku, Yoshihiko
    Tokuda, Keiichi
    2013 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2013,
  • [42] Markov Chain Monte Carlo Simulation for Bayesian Hidden Markov Models
    Chan, Lay Guat
    Ibrahim, Adriana Irawati Nur Binti
    4TH INTERNATIONAL CONFERENCE ON QUANTITATIVE SCIENCES AND ITS APPLICATIONS (ICOQSIA 2016), 2016, 1782
  • [43] Stochastic complexity of variational Bayesian hidden Marko models
    Hosino, T
    Watanabe, K
    Watanabe, S
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 1114 - 1119
  • [44] Bayesian nonparametric Hidden semi-Markov models
    Johnson, Matthew J.
    Willsky, Alan S.
    Journal of Machine Learning Research, 2013, 14 (01) : 673 - 701
  • [45] Structural Bayesian Linear Regression for Hidden Markov Models
    Shinji Watanabe
    Atsushi Nakamura
    Biing-Hwang (Fred) Juang
    Journal of Signal Processing Systems, 2014, 74 : 341 - 358
  • [46] DISCRIMINATIVE TRAINING FOR BAYESIAN SENSING HIDDEN MARKOV MODELS
    Saon, George
    Chien, Jen-Tzung
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 5316 - 5319
  • [47] Computational Bayesian analysis of hidden Markov mesh models
    Dunmur, AP
    Titterington, DM
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (11) : 1296 - 1300
  • [48] BAYESIAN SENSING HIDDEN MARKOV MODELS FOR SPEECH RECOGNITION
    Saon, George
    Chien, Jen-Tzung
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 5056 - 5059
  • [49] Structural Bayesian Linear Regression for Hidden Markov Models
    Watanabe, Shinji
    Nakamura, Atsushi
    Juang, Biing-Hwang
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2014, 74 (03): : 341 - 358
  • [50] Bayesian Nonparametric Hidden Semi-Markov Models
    Johnson, Matthew J.
    Willsky, Alan S.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 673 - 701