Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application

被引:7
|
作者
Lai, Yuping [1 ]
Ping, Yuan [2 ]
Xiao, Ke [1 ]
Hao, Bin [3 ]
Zhang, Xiufeng [4 ]
机构
[1] North China Univ Technol, Coll Comp Sci & Technol, Beijing, Peoples R China
[2] Xuchang Univ, Sch Informat Engn, Xuchang, Peoples R China
[3] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[4] Natl Res Ctr Rehabil Tech Aids, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Dirichlet process; Nonparametric Bayesian analysis; Beta distribution; Infinite mixture model; Variational inference; Image categorization; Object detection; HIDDEN MARKOV MODEL; INFORMATION CRITERION; CLASSIFICATION;
D O I
10.1016/j.neucom.2017.07.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite beta mixture model (BMM) has been shown to be very flexible and powerful for bounded support data modeling. However, BMM cannot automatically select the proper number of the mixture components based on the observed data, which is important and has a deterministic effect on the modeling accuracy. In this paper, we aim at tackling this problem by infinite Beta mixture model (InBMM). It is based on the Dirichlet process (DP) mixture with the assumption that the number of the mixture components is infinite in advance and can be automatically determined according to the observed data. Further, a variational InBMM using single lower- bound approximation (VBInBMM) is proposed which applies the stick-breaking representation of the DP and is learned by an extended variational inference framework. Numerical experiments on both synthetic and real data, generated from two challenging application namely image categorization and object detection, demonstrate good performance obtained by the proposed method. (C) 2017 Published by Elsevier B. V.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [41] Variational Bayesian inference for infinite generalized inverted Dirichlet mixtures with feature selection and its application to clustering
    Taoufik Bdiri
    Nizar Bouguila
    Djemel Ziou
    Applied Intelligence, 2016, 44 : 507 - 525
  • [42] Community Embeddings with Bayesian Gaussian Mixture Model and Variational Inference
    Begehr, Anton I. N.
    Panfilov, Peter B.
    2022 IEEE 24TH CONFERENCE ON BUSINESS INFORMATICS (CBI 2022), VOL 2, 2022, : 88 - 96
  • [43] Bayesian Estimation of Inverted Beta Mixture Models With Extended Stochastic Variational Inference for Positive Vector Classification
    Lai, Yuping
    Guan, Wenbo
    Luo, Lijuan
    Guo, Yanhui
    Song, Heping
    Meng, Hongying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 6948 - 6962
  • [44] Variational approximations in Bayesian model selection for finite mixture distributions
    McGrory, C. A.
    Titterington, D. M.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 51 (11) : 5352 - 5367
  • [45] Variational Bayesian Mixture Model on a Subspace of Exponential Family Distributions
    Watanabe, Kazuho
    Akaho, Shotaro
    Omachi, Shinichiro
    Okada, Masato
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (11): : 1783 - 1796
  • [46] Bayesian inference for a flexible class of bivariate beta distributions
    Crackel, Roberto
    Flegal, James
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2017, 87 (02) : 295 - 312
  • [47] Bayesian Inference of Mixture of two Rayleigh Distributions: ANew Look
    Sindhu, Tabassum Naz
    Feroze, Navid
    Aslam, Muhammad
    Shafiq, Anum
    PUNJAB UNIVERSITY JOURNAL OF MATHEMATICS, 2016, 48 (02): : 49 - 64
  • [48] Batch and online variational learning of hierarchical Dirichlet process mixtures of multivariate Beta distributions in medical applications
    Manouchehri, Narges
    Bouguila, Nizar
    Fan, Wentao
    PATTERN ANALYSIS AND APPLICATIONS, 2021, 24 (04) : 1731 - 1744
  • [49] Bayesian inference for linear dynamic models with Dirichlet process mixtures
    Caron, Francois
    Davy, Manuel
    Doucet, Arnaud
    Duflos, Emmanuel
    Vanheeghe, Philippe
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (01) : 71 - 84
  • [50] Batch and online variational learning of hierarchical Dirichlet process mixtures of multivariate Beta distributions in medical applications
    Narges Manouchehri
    Nizar Bouguila
    Wentao Fan
    Pattern Analysis and Applications, 2021, 24 : 1731 - 1744