On Convergence Rates of Mixtures of Polynomial Experts

被引:7
|
作者
Mendes, Eduardo F. [1 ]
Jiang, Wenxin [1 ]
机构
[1] Northwestern Univ, Dept Stat, Evanston, IL 60208 USA
关键词
GENERALIZED LINEAR-MODELS; HIERARCHICAL MIXTURES; OF-EXPERTS; TIME-SERIES; BAYESIAN-INFERENCE; LOCAL MIXTURES; APPROXIMATION; REGRESSION; ESTIMATORS; SIEVE;
D O I
10.1162/NECO_a_00354
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this letter, we consider a mixture-of-experts structure where m experts are mixed, with each expert being related to a polynomial regression model of order k. We study the convergence rate of the maximum likelihood estimator in terms of how fast the Hellinger distance of the estimated density converges to the true density, when the sample size n increases. The convergence rate is found to be dependent on both m and k, while certain choices of m and k are found to produce near-optimal convergence rates.
引用
收藏
页码:3025 / 3051
页数:27
相关论文
共 50 条
  • [1] Convergence Rates for Gaussian Mixtures of Experts
    Ho, Nhat
    Yang, Chiao-Yu
    Jordan, Michael I.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [2] Convergence Rates for Gaussian Mixtures of Experts
    Ho, Nhat
    Yang, Chiao-Yu
    Jordan, Michael I.
    Journal of Machine Learning Research, 2022, 23
  • [3] Polynomial convergence rates of Markov chains
    Jarner, SF
    Roberts, GO
    ANNALS OF APPLIED PROBABILITY, 2002, 12 (01): : 224 - 247
  • [4] Convergence results for the EM approach to mixtures of experts architectures
    Jordan, MI
    Xu, L
    NEURAL NETWORKS, 1995, 8 (09) : 1409 - 1431
  • [5] Polynomial Convergence Rates of Piecewise Deterministic Markov Processes
    Roberts, Gareth O.
    Rosenthal, Jeffrey S.
    METHODOLOGY AND COMPUTING IN APPLIED PROBABILITY, 2023, 25 (01)
  • [6] Polynomial Convergence Rates of Piecewise Deterministic Markov Processes
    Gareth O. Roberts
    Jeffrey S. Rosenthal
    Methodology and Computing in Applied Probability, 2023, 25
  • [7] Polynomial-Spline Networks with Exact Integrals and Convergence Rates
    Actor, Jonas A.
    Huang, Andy
    Trask, Nat
    2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 1156 - 1163
  • [8] RATES OF CONVERGENCE OF SOME MULTIVARIATE MARKOV CHAINS WITH POLYNOMIAL EIGENFUNCTIONS
    Khare, Kshitij
    Zhou, Hua
    ANNALS OF APPLIED PROBABILITY, 2009, 19 (02): : 737 - 777
  • [9] On optimal convergence rates of Laguerre polynomial expansions for piecewise functions
    Zhang, Yali
    Xiang, Shuhuang
    Kong, Desong
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2023, 425
  • [10] Polynomial and rational convergence rates for Laplace problems on planar domains
    Trefethen, Lloyd N.
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2024, 480 (2295):