Model clustering for neural network ensembles

被引:0
|
作者
Bakker, B [1 ]
Heskes, T [1 ]
机构
[1] Univ Nijmegen, SNN, NL-6525 EZ Nijmegen, Netherlands
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We show that large ensembles of (neural network) models, obtained e.g. in bootstrapping or sampling from (Bayesian) probability distributions, can be effectively summarized by a relatively small number of representative models. We present a method to find representative models through clustering based on the models' outputs on a data set. We apply the method on models obtained through bootstrapping (Boston housing) and on a multitask learning example.
引用
收藏
页码:383 / 388
页数:6
相关论文
共 50 条
  • [1] Clustering ensembles of neural network models
    Bakker, B
    Heskes, T
    NEURAL NETWORKS, 2003, 16 (02) : 261 - 269
  • [2] Neural Network Ensembles using Clustering Ensemble and Genetic Algorithm
    Mohammadi, Moslem
    Alizadeh, Hosein
    Minaei-Bidgoli, Behrouz
    THIRD 2008 INTERNATIONAL CONFERENCE ON CONVERGENCE AND HYBRID INFORMATION TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 761 - +
  • [3] Reducing fitness evaluations using clustering techniques and neural network ensembles
    Jin, YC
    Sendhoff, B
    GENETIC AND EVOLUTIONARY COMPUTATION - GECCO 2004, PT 1, PROCEEDINGS, 2004, 3102 : 688 - 699
  • [4] NEURAL NETWORK ENSEMBLES
    HANSEN, LK
    SALAMON, P
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (10) : 993 - 1001
  • [5] Clustering and co-evolution to construct neural network ensembles: An experimental study
    Minku, Fernanda L.
    Ludermir, Teresa B.
    NEURAL NETWORKS, 2008, 21 (09) : 1363 - 1379
  • [6] Using Neural Network Emulations of Model Physics in Numerical Model Ensembles
    Krasnopolsky, Vladimir
    Fox-Rabinovitz, Michael S.
    Belochitski, Alexei
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 1523 - 1530
  • [7] A mixture model for clustering ensembles
    Topchy, A
    Jain, AK
    Punch, W
    PROCEEDINGS OF THE FOURTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, 2004, : 379 - 390
  • [8] A clustering neural network model of insect olfaction
    Pehlevan, Cengiz
    Genkin, Alexander
    Chklovskii, Dmitri B.
    2017 FIFTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2017, : 593 - 600
  • [9] A survey of neural network ensembles
    Zhao, Y
    Gao, J
    Yang, XZ
    PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 438 - 442
  • [10] Multistage neural network ensembles
    Yang, S
    Browne, A
    Picton, PD
    MULTIPLE CLASSIFIER SYSTEMS, 2002, 2364 : 91 - 97