Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application

被引:7
|
作者
Lai, Yuping [1 ]
Ping, Yuan [2 ]
Xiao, Ke [1 ]
Hao, Bin [3 ]
Zhang, Xiufeng [4 ]
机构
[1] North China Univ Technol, Coll Comp Sci & Technol, Beijing, Peoples R China
[2] Xuchang Univ, Sch Informat Engn, Xuchang, Peoples R China
[3] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[4] Natl Res Ctr Rehabil Tech Aids, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Dirichlet process; Nonparametric Bayesian analysis; Beta distribution; Infinite mixture model; Variational inference; Image categorization; Object detection; HIDDEN MARKOV MODEL; INFORMATION CRITERION; CLASSIFICATION;
D O I
10.1016/j.neucom.2017.07.068
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Finite beta mixture model (BMM) has been shown to be very flexible and powerful for bounded support data modeling. However, BMM cannot automatically select the proper number of the mixture components based on the observed data, which is important and has a deterministic effect on the modeling accuracy. In this paper, we aim at tackling this problem by infinite Beta mixture model (InBMM). It is based on the Dirichlet process (DP) mixture with the assumption that the number of the mixture components is infinite in advance and can be automatically determined according to the observed data. Further, a variational InBMM using single lower- bound approximation (VBInBMM) is proposed which applies the stick-breaking representation of the DP and is learned by an extended variational inference framework. Numerical experiments on both synthetic and real data, generated from two challenging application namely image categorization and object detection, demonstrate good performance obtained by the proposed method. (C) 2017 Published by Elsevier B. V.
引用
收藏
页码:23 / 33
页数:11
相关论文
共 50 条
  • [1] Online Learning of a Dirichlet Process Mixture of Beta-Liouville Distributions via Variational Inference
    Fan, Wentao
    Bouguila, Nizar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (11) : 1850 - 1862
  • [2] Extended variational inference for Dirichlet process mixture of Beta-Liouville distributions for proportional data modeling
    Lai, Yuping
    Guan, Wenbo
    Luo, Lijuan
    Ruan, Qiang
    Ping, Yuan
    Song, Heping
    Meng, Hongying
    Pan, Yu
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (07) : 4277 - 4306
  • [3] Online Variational Learning for a Dirichlet Process Mixture of Dirichlet Distributions and Its Application
    Fan, Wentao
    Bouguila, Nizar
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, : 362 - 367
  • [4] Dirichlet process mixture model based nonparametric Bayesian modeling and variational inference
    Fei, Zhengshun
    Liu, Kangling
    Huang, Bingqiang
    Zheng, Yongping
    Xiang, Xinjian
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3048 - 3051
  • [5] Bayesian estimation of Dirichlet mixture model with variational inference
    Ma, Zhanyu
    Rana, Pravin Kumar
    Taghia, Jalil
    Flierl, Markus
    Leijon, Arne
    PATTERN RECOGNITION, 2014, 47 (09) : 3143 - 3157
  • [6] Dirichlet Process Mixture of Generalized Inverted Dirichlet Distributions for Positive Vector Data With Extended Variational Inference
    Ma, Zhanyu
    Lai, Yuping
    Xie, Jiyang
    Meng, Deyu
    Kleijn, W. Bastiaan
    Guo, Jun
    Yu, Jingyi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6089 - 6102
  • [7] Fast Bayesian Inference in Dirichlet Process Mixture Models
    Wang, Lianming
    Dunson, David B.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2011, 20 (01) : 196 - 216
  • [8] Bayesian Estimation of Beta Mixture Models with Variational Inference
    Ma, Zhanyu
    Leijon, Arne
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (11) : 2160 - 2173
  • [9] Variational Bayesian Inference for Finite Inverted Dirichlet Mixture Model and Its Application to Object Detection
    Lai Yuping
    Ping Yuan
    He Wenda
    Wang Baocheng
    Wang Jingzhong
    Zhang Xiufeng
    CHINESE JOURNAL OF ELECTRONICS, 2018, 27 (03) : 603 - 610
  • [10] Variational Bayesian Inference for Finite Inverted Dirichlet Mixture Model and Its Application to Object Detection
    LAI Yuping
    PING Yuan
    HE Wenda
    WANG Baocheng
    WANG Jingzhong
    ZHANG Xiufeng
    Chinese Journal of Electronics, 2018, 27 (03) : 603 - 610