Adaptive Bayesian multivariate density estimation with Dirichlet mixtures

被引:79
|
作者
Shen, Weining [1 ]
Tokdar, Surya T. [2 ]
Ghosal, Subhashis [1 ]
机构
[1] N Carolina State Univ, Dept Stat, Raleigh, NC 27695 USA
[2] Duke Univ, Dept Stat Sci, Durham, NC 27708 USA
基金
美国国家科学基金会;
关键词
Anisotropy; Dirichlet mixture; Multivariate density estimation; Nonparametric Bayesian method; Rate adaptation; POSTERIOR DISTRIBUTIONS; CONVERGENCE-RATES; MODEL SELECTION; INFERENCE;
D O I
10.1093/biomet/ast015
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We show that rate-adaptive multivariate density estimation can be performed using Bayesian methods based on Dirichlet mixtures of normal kernels with a prior distribution on the kernel's covariance matrix parameter. We derive sufficient conditions on the prior specification that guarantee convergence to a true density at a rate that is minimax optimal for the smoothness class to which the true density belongs. No prior knowledge of smoothness is assumed. The sufficient conditions are shown to hold for the Dirichlet location mixture-of-normals prior with a Gaussian base measure and an inverse Wishart prior on the covariance matrix parameter. Locally Holder smoothness classes and their anisotropic extensions are considered. Our study involves several technical novelties, including sharp approximation of finitely differentiable multivariate densities by normal mixtures and a new sieve on the space of such densities.
引用
收藏
页码:623 / 640
页数:18
相关论文
共 50 条
  • [31] Adaptive learning of Bayesian networks for the qualification of traffic data by contaminated Dirichlet density functions
    Junghans, Marek
    Jentschel, Hans-Joachim
    PROCEEDINGS OF THE 2008 1ST INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, 2008, : 369 - 372
  • [32] Multivariate Bayesian function estimation
    Angers, JF
    Kim, PT
    ANNALS OF STATISTICS, 2005, 33 (06): : 2967 - 2999
  • [33] Mixtures density estimation in lifetime data analysis: an application of nonparametric Bayesian estimation technique
    Hossain, Ahmed
    Khan, Hafiz T. A.
    JOURNAL OF STATISTICS AND MANAGEMENT SYSTEMS, 2010, 13 (03) : 605 - 615
  • [34] Bayesian density estimation and model selection using nonparametric hierarchical mixtures
    Argiento, Raffaele
    Guglielmi, Alessandra
    Pievatolo, Antonio
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (04) : 816 - 832
  • [35] Bayesian estimation of the Kullback-Leibler divergence for categorical systems using mixtures of Dirichlet priors
    Camaglia, Francesco
    Nemenman, Ilya
    Mora, Thierry
    Walczak, Aleksandra M.
    PHYSICAL REVIEW E, 2024, 109 (02)
  • [36] Regression density estimation using smooth adaptive Gaussian mixtures
    Villani, Mattias
    Kohn, Robert
    Giordani, Paolo
    JOURNAL OF ECONOMETRICS, 2009, 153 (02) : 155 - 173
  • [37] Nonparametric Estimation of Multivariate Mixtures
    Zheng, Chaowen
    Wu, Yichao
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2020, 115 (531) : 1456 - 1471
  • [38] ESTIMATION OF A MULTIVARIATE DENSITY
    CACOULLOS, T
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 1966, 18 (02) : 179 - +
  • [39] MIXTURES OF DIRICHLET PROCESSES WITH APPLICATIONS TO BAYESIAN NONPARAMETRIC PROBLEMS
    ANTONIAK, CE
    ANNALS OF STATISTICS, 1974, 2 (06): : 1152 - 1174
  • [40] Bayesian Nonnegative Matrix Factorization With Dirichlet Process Mixtures
    Li, Caoyuan
    Xie, Hong-Bo
    Mengersen, Kerrie
    Fan, Xuhui
    Da Xu, Richard Yi
    Sisson, Scott A.
    Van Huffel, Sabine
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 3860 - 3870