On Convergence Rates of Mixtures of Polynomial Experts

被引：7
|
作者：
Mendes, Eduardo F. [1 ]
Jiang, Wenxin [1 ]
机构：
[1] Northwestern Univ, Dept Stat, Evanston, IL 60208 USA
来源：
NEURAL COMPUTATION | 2012年 / 24卷 / 11期
关键词：
GENERALIZED LINEAR-MODELS; HIERARCHICAL MIXTURES; OF-EXPERTS; TIME-SERIES; BAYESIAN-INFERENCE; LOCAL MIXTURES; APPROXIMATION; REGRESSION; ESTIMATORS; SIEVE;
D O I：
10.1162/NECO_a_00354
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this letter, we consider a mixture-of-experts structure where m experts are mixed, with each expert being related to a polynomial regression model of order k. We study the convergence rate of the maximum likelihood estimator in terms of how fast the Hellinger distance of the estimated density converges to the true density, when the sample size n increases. The convergence rate is found to be dependent on both m and k, while certain choices of m and k are found to produce near-optimal convergence rates.
引用
收藏
页码：3025 / 3051
页数：27
相关论文
共 50 条
  • [11] Posterior convergence rates for Dirichlet mixtures of beta densities
    Kruijer, Willem
    van der Vaart, Aad
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2008, 138 (07) : 1981 - 1992
  • [12] Posterior convergence rates of dirichlet mixtures at smooth densities
    Ghosal, Subhashis
    van der Vaart, Aad
    ANNALS OF STATISTICS, 2007, 35 (02): : 697 - 723
  • [13] ON INTERPOLATION APPROXIMATION: CONVERGENCE RATES FOR POLYNOMIAL INTERPOLATION FOR FUNCTIONS OF LIMITED REGULARITY
    Xiang, Shuhuang
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2016, 54 (04) : 2081 - 2113
  • [14] Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts
    Nguyen, Huy
    Nguyen, TrungTin
    Nguyen, Khai
    Ho, Nhat
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
  • [15] Posterior rates of convergence for Dirichlet mixtures of exponential power densities
    Scricciolo, Catia
    ELECTRONIC JOURNAL OF STATISTICS, 2011, 5 : 270 - 308
  • [16] On strong identifiability and convergence rates of parameter estimation in finite mixtures
    Nhat Ho
    XuanLong Nguyen
    ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (01): : 271 - 307
  • [17] CONVERGENCE-RATES FOR TRIGONOMETRIC AND POLYNOMIAL-TRIGONOMETRIC REGRESSION-ESTIMATORS
    EUBANK, RL
    SPECKMAN, P
    STATISTICS & PROBABILITY LETTERS, 1991, 11 (02) : 119 - 124
  • [18] Convergence rates for uniform confidence intervals based on local polynomial regression estimators
    De Brabanter, K.
    Liu, Y.
    Hua, C.
    JOURNAL OF NONPARAMETRIC STATISTICS, 2016, 28 (01) : 31 - 48
  • [19] Mixtures of Heterogeneous Experts
    Parton, Callum
    Engelbrecht, Andries
    2020 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, METAHEURISTICS & SWARM INTELLIGENCE (ISMSI 2020), 2020, : 1 - 7
  • [20] CONVERGENCE RATES OF PARAMETER ESTIMATION FOR SOME WEAKLY IDENTIFIABLE FINITE MIXTURES
    Ho, Nhat
    Nguyen, Xuanlong
    ANNALS OF STATISTICS, 2016, 44 (06): : 2726 - 2755
12345