Optimal model inference for Bayesian mixture of experts

被引：0

作者：

Ueda, N ^{[1
]}

Ghahramani, Z ^{[1
]}

机构：

[1] NTT, Commun Sci Labs, Kyoto 6190237, Japan

来源：

NEURAL NETWORKS FOR SIGNAL PROCESSING X, VOLS 1 AND 2, PROCEEDINGS | 2000年

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We present an algorithm for inferring the parameter and model structure of a mixture of experts model (MoE) based on the variational Bayesian (VB) framework. First, in the VB framework, we show that the model parameter and structure of a MoE can be simultaneously optimized by maximizing an objective funtion derived in this paper. Next, we present a deterministic algorithm to find the optimal number of experts of a MoE while avoiding local maxima. Our experimental results demonstrate the practical usefulness of the method.

引用

页码：145 / 154

页数：10

共 50 条

[21] Bayesian Inference in Infinite Multivariate McDonald's Beta Mixture Model
Forouzanfar, Darya
Manouchehri, Narges
Bouguila, Nizar
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2023, PT II, 2023, 14126 : 320 - 330
[22] Laplacian-P-splines for Bayesian inference in the mixture cure model
Gressani, Oswaldo
Faes, Christel
Hens, Niel
STATISTICS IN MEDICINE, 2022, 41 (14) : 2602 - 2626
[23] Sensitivity analysis using a Bayesian mixture of experts model for a bifurcating Duffing oscillator
Baldacchino, T.
Worden, K.
Rowson, J.
PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NOISE AND VIBRATION ENGINEERING (ISMA2014) AND INTERNATIONAL CONFERENCE ON UNCERTAINTY IN STRUCTURAL DYNAMICS (USD2014), 2014, : 4437 - 4452
[24] Approximate Bayesian Inference Methods for Mixture Filtering with Known Model of Switching
Papez, Milan
PROCEEDINGS OF THE 2016 17TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE (ICCC), 2016, : 545 - 551
[25] Bayesian inference with optimal maps
El Moselhy, Tarek A.
Marzouk, Youssef M.
JOURNAL OF COMPUTATIONAL PHYSICS, 2012, 231 (23) : 7815 - 7850
[26] Denoising OCT Images Using Steered Mixture of Experts with Multi-Model Inference
Ozkan, Aytac
Stoykova, Elena
Sikora, Thomas
Madjarova, Violeta
OPTICAL COHERENCE TOMOGRAPHY AND COHERENCE DOMAIN OPTICAL METHODS IN BIOMEDICINE XXVIII, 2024, 12830
[27] Bayesian Estimation of the von-Mises Fisher Mixture Model with Variational Inference
Taghia, Jalil
Ma, Zhanyu
Leijon, Arne
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (09) : 1701 - 1715
[28] Dirichlet process mixture model based nonparametric Bayesian modeling and variational inference
Fei, Zhengshun
Liu, Kangling
Huang, Bingqiang
Zheng, Yongping
Xiang, Xinjian
2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3048 - 3051
[29] Approximate Bayesian inference for mixture cure models
E. Lázaro
C. Armero
V. Gómez-Rubio
TEST, 2020, 29 : 750 - 767
[30] Approximate Bayesian inference for mixture cure models
Lazaro, E.
Armero, C.
Gomez-Rubio, V
TEST, 2020, 29 (03) : 750 - 767

← 1 2 3 4 5 →