Online Variational Learning of Dirichlet Process Mixtures of Scaled Dirichlet Distributions

被引:9
|
作者
Manouchehri, Narges [1 ]
Nguyen, Hieu [1 ]
Koochemeshkian, Pantea [2 ]
Bouguila, Nizar [1 ]
Fan, Wentao [3 ]
机构
[1] Concordia Univ, Concordia Inst Informat Syst Engn, Montreal, PQ H3G 1M8, Canada
[2] Concordia Univ, Dept Elect & Comp Engn, Montreal, PQ H3G 1M8, Canada
[3] Huaqiao Univ, Dept Comp Sci & Technol, Xiamen, Peoples R China
基金
加拿大自然科学与工程研究理事会; 中国国家自然科学基金;
关键词
Infinite mixture models; Dirichlet process mixtures of scaled Dirichlet distributions; Online variational learning; Spam categorization; Diabetes; Hepatitis; UNSUPERVISED SELECTION; MODEL;
D O I
10.1007/s10796-020-10027-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data clustering as an unsupervised method has been one of the main attention-grabbing techniques and a large class of tasks can be formulated by this method. Mixture models as a branch of clustering methods have been used in various fields of research such as computer vision and pattern recognition. To apply these models, we need to address some problems such as finding a proper distribution that properly fits data, defining model complexity and estimating the model parameters. In this paper, we apply scaled Dirichlet distribution to tackle the first challenge and propose a novel online variational method to mitigate the other two issues simultaneously. The effectiveness of the proposed work is evaluated by four challenging real applications, namely, text and image spam categorization, diabetes and hepatitis detection.
引用
收藏
页码:1085 / 1093
页数:9
相关论文
共 50 条
  • [21] A DIRICHLET PROCESS MIXTURE OF DIRICHLET DISTRIBUTIONS FOR CLASSIFICATION AND PREDICTION
    Bouguila, Nizar
    Ziou, Djemel
    2008 IEEE WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2008, : 297 - +
  • [22] Dirichlet Mixtures, the Dirichlet Process, and the Structure of Protein Space
    Viet-An Nguyen
    Boyd-Graber, Jordan
    Altschul, Stephen F.
    JOURNAL OF COMPUTATIONAL BIOLOGY, 2013, 20 (01) : 1 - 18
  • [23] Data Clustering using Variational Learning of Finite Scaled Dirichlet Mixture Models
    Hieu Nguyen
    Azam, Muhammad
    Bouguila, Nizar
    2019 IEEE 28TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2019, : 1391 - 1396
  • [24] Variational Bayesian inference for a Dirichlet process mixture of beta distributions and application
    Lai, Yuping
    Ping, Yuan
    Xiao, Ke
    Hao, Bin
    Zhang, Xiufeng
    NEUROCOMPUTING, 2018, 278 : 23 - 33
  • [25] Online variational learning of generalized Dirichlet mixture models with feature selection
    Fan, Wentao
    Bouguila, Nizar
    NEUROCOMPUTING, 2014, 126 : 166 - 179
  • [26] Text Modeling Using Multinomial Scaled Dirichlet Distributions
    Zamzami, Nuha
    Bouguila, Nizar
    RECENT TRENDS AND FUTURE TECHNOLOGY IN APPLIED INTELLIGENCE, IEA/AIE 2018, 2018, 10868 : 69 - 80
  • [27] A hierarchical Dirichlet process mixture of generalized Dirichlet distributions for feature selection
    Fan, Wentao
    Sallay, Hassen
    Bouguila, Nizar
    Bourouis, Sami
    COMPUTERS & ELECTRICAL ENGINEERING, 2015, 43 : 48 - 65
  • [28] A Dirichlet Process Mixture of Generalized Dirichlet Distributions for Proportional Data Modeling
    Bouguila, Nizar
    Ziou, Djemel
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (01): : 107 - 122
  • [29] Scale mixtures of Kotz-Dirichlet distributions
    Balakrishnan, N.
    Hashorva, E.
    JOURNAL OF MULTIVARIATE ANALYSIS, 2013, 113 : 48 - 58
  • [30] Online Learning of Hierarchical Pitman-Yor Process Mixture of Generalized Dirichlet Distributions With Feature Selection
    Fan, Wentao
    Sallay, Hassen
    Bouguila, Nizar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (09) : 2048 - 2061