Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application

被引:7
|
作者
Lai, Yuping [1 ]
Ping, Yuan [2 ]
Xiao, Ke [1 ]
Hao, Bin [3 ]
Zhang, Xiufeng [4 ]
机构
[1] North China Univ Technol, Coll Comp Sci & Technol, Beijing, Peoples R China
[2] Xuchang Univ, Sch Informat Engn, Xuchang, Peoples R China
[3] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[4] Natl Res Ctr Rehabil Tech Aids, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Dirichlet process; Nonparametric Bayesian analysis; Beta distribution; Infinite mixture model; Variational inference; Image categorization; Object detection; HIDDEN MARKOV MODEL; INFORMATION CRITERION; CLASSIFICATION;
D O I
10.1016/j.neucom.2017.07.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite beta mixture model (BMM) has been shown to be very flexible and powerful for bounded support data modeling. However, BMM cannot automatically select the proper number of the mixture components based on the observed data, which is important and has a deterministic effect on the modeling accuracy. In this paper, we aim at tackling this problem by infinite Beta mixture model (InBMM). It is based on the Dirichlet process (DP) mixture with the assumption that the number of the mixture components is infinite in advance and can be automatically determined according to the observed data. Further, a variational InBMM using single lower- bound approximation (VBInBMM) is proposed which applies the stick-breaking representation of the DP and is learned by an extended variational inference framework. Numerical experiments on both synthetic and real data, generated from two challenging application namely image categorization and object detection, demonstrate good performance obtained by the proposed method. (C) 2017 Published by Elsevier B. V.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [21] Variational learning for Dirichlet process mixtures of Dirichlet distributions and applications
    Fan, Wentao
    Bouguila, Nizar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 70 (03) : 1685 - 1702
  • [22] Variational learning for Dirichlet process mixtures of Dirichlet distributions and applications
    Wentao Fan
    Nizar Bouguila
    Multimedia Tools and Applications, 2014, 70 : 1685 - 1702
  • [23] Collapsed Variational Dirichlet Process Mixture Models
    Kurihara, Kenichi
    Welling, Max
    Teh, Yee Whye
    20TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2007, : 2796 - 2801
  • [24] Distributed Inference for Dirichlet Process Mixture Models
    Ge, Hong
    Chen, Yutian
    Wan, Moquan
    Ghahramani, Zoubin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 2276 - 2284
  • [25] Bayesian haplotype inference via the Dirichlet process
    Xing, Eric P.
    Jordan, Michael I.
    Sharan, Roded
    JOURNAL OF COMPUTATIONAL BIOLOGY, 2007, 14 (03) : 267 - 284
  • [26] Predictive Distribution of the Dirichlet Mixture Model by Local Variational Inference
    Zhanyu Ma
    Arne Leijon
    Zheng-Hua Tan
    Sheng Gao
    Journal of Signal Processing Systems, 2014, 74 : 359 - 374
  • [27] Predictive Distribution of the Dirichlet Mixture Model by Local Variational Inference
    Ma, Zhanyu
    Leijon, Arne
    Tan, Zheng-Hua
    Gao, Sheng
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2014, 74 (03): : 359 - 374
  • [28] Stochastic Collapsed Variational Bayesian Inference for Latent Dirichlet Allocation
    Foulds, James
    Boyles, Levi
    DuBois, Christopher
    Smyth, Padhraic
    Welling, Max
    19TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'13), 2013, : 446 - 454
  • [29] Sparse Bayesian Hierarchical Mixture of Experts and Variational Inference
    Iikubo, Yuji
    Horii, Shunsuke
    Matsushima, Toshiyasu
    PROCEEDINGS OF 2018 INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY AND ITS APPLICATIONS (ISITA2018), 2018, : 60 - 64
  • [30] Streaming Variational Inference for Bayesian Nonparametric Mixture Models
    Tank, Alex
    Foti, Nicholas J.
    Fox, Emily B.
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 968 - 976