Online Variational Learning of Dirichlet Process Mixtures of Scaled Dirichlet Distributions

被引:9
|
作者
Manouchehri, Narges [1 ]
Nguyen, Hieu [1 ]
Koochemeshkian, Pantea [2 ]
Bouguila, Nizar [1 ]
Fan, Wentao [3 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn, Montreal, PQ H3G 1M8, Canada
[2] Concordia Univ, Dept Elect & Comp Engn, Montreal, PQ H3G 1M8, Canada
[3] Huaqiao Univ, Dept Comp Sci & Technol, Xiamen, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Infinite mixture models; Dirichlet process mixtures of scaled Dirichlet distributions; Online variational learning; Spam categorization; Diabetes; Hepatitis; UNSUPERVISED SELECTION; MODEL;
D O I
10.1007/s10796-020-10027-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data clustering as an unsupervised method has been one of the main attention-grabbing techniques and a large class of tasks can be formulated by this method. Mixture models as a branch of clustering methods have been used in various fields of research such as computer vision and pattern recognition. To apply these models, we need to address some problems such as finding a proper distribution that properly fits data, defining model complexity and estimating the model parameters. In this paper, we apply scaled Dirichlet distribution to tackle the first challenge and propose a novel online variational method to mitigate the other two issues simultaneously. The effectiveness of the proposed work is evaluated by four challenging real applications, namely, text and image spam categorization, diabetes and hepatitis detection.
引用
收藏
页码:1085 / 1093
页数:9
相关论文
共 50 条
  • [41] Bayesian Outlier Detection with Dirichlet Process Mixtures
    Shotwell, Matthew S.
    Slate, Elizabeth H.
    BAYESIAN ANALYSIS, 2011, 6 (04): : 665 - 690
  • [42] Dirichlet Process Mixtures of Linear Mixed Regressions
    Kyung, Minjung
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2015, 22 (06) : 625 - 637
  • [43] Nonparametric Localized Feature Selection via a Dirichlet Process Mixture of Generalized Dirichlet Distributions
    Fan, Wentao
    Bouguila, Nizar
    NEURAL INFORMATION PROCESSING, ICONIP 2012, PT III, 2012, 7665 : 25 - 33
  • [44] Bayesian ratemaking under Dirichlet process mixtures
    Zhang, J.
    Huang, J.
    Wu, X.
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2017, 46 (22) : 11327 - 11340
  • [45] Maximum Margin Dirichlet Process Mixtures for Clustering
    Chen, Gang
    Zhang, Haiying
    Xiong, Caiming
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 1491 - 1497
  • [46] Dirichlet Process Mixtures of Generalized Linear Models
    Hannah, Lauren A.
    Blei, David M.
    Powell, Warren B.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2011, 12 : 1923 - 1953
  • [47] Nonlinear Models Using Dirichlet Process Mixtures
    Shahbaba, Babak
    Neal, Radford
    JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 1829 - 1850
  • [48] APPLICATIONS OF DIRICHLET PROCESS MIXTURES TO SPEAKER ADAPTATION
    Torbati, Amir Hossein Harati Nejad
    Picone, Joe
    Sobel, Marc
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 4321 - 4324
  • [49] Dirichlet Variational Autoencoder
    Joo, Weonyoung
    Lee, Wonsung
    Park, Sungrae
    Moon, Il-Chul
    PATTERN RECOGNITION, 2020, 107
  • [50] DIFFERENCE-OF-CONVEX OPTIMIZATION FOR VARIATIONAL KL-CORRECTED INFERENCE IN DIRICHLET PROCESS MIXTURES
    Bonnevie, Rasmus
    Schmidt, Mikkel N.
    Morup, Morten
    2017 IEEE 27TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2017,