A mixed-categorical correlation kernel for Gaussian process

被引:6
|
作者
Saves, P. [1 ,2 ]
Diouane, Y. [3 ]
Bartoli, N. [1 ]
Lefebvre, T. [1 ]
Morlier, J. [4 ]
机构
[1] Univ Toulouse, ONERA, DTIS, F-31055 Toulouse, France
[2] Univ Toulouse, ISAE SUPAERO, F-31055 Toulouse 4, France
[3] Polytech Montreal, Montreal, PQ, Canada
[4] Univ Toulouse, Inst Clement Ader ICA, ISAE SUPAERO, Mines Albi,UPS,INSA,CNRS, 3 Rue Caroline Aigle, F-31400 Toulouse, France
基金
欧盟地平线“2020”;
关键词
Gaussian process; Mixed-categorical; Continuous relaxation; Hypersphere decomposition; Bayesian optimization; Surrogate modeling toolbox; OPTIMIZATION; REGRESSION; MODELS;
D O I
10.1016/j.neucom.2023.126472
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian pro-cess (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estima-tion of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surro-gate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Kernel discriminant analysis and clustering with parsimonious Gaussian process models
    C. Bouveyron
    M. Fauvel
    S. Girard
    Statistics and Computing, 2015, 25 : 1143 - 1162
  • [42] Scalable Variational Bayesian Kernel Selection for Sparse Gaussian Process Regression
    Teng, Tong
    Chen, Jie
    Zhang, Yehong
    Low, Kian Hsiang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5997 - 6004
  • [43] KERNEL ESTIMATES FOR CATEGORICAL-DATA
    BROWN, PJ
    RUNDELL, PWK
    TECHNOMETRICS, 1985, 27 (03) : 293 - 299
  • [44] MIXED GAUSSIAN AND IMPULSE NOISE REMOVAL BASED ON KERNEL OBSERVATION AND EDGE DIRECTION
    Utaminingrum, Fitri
    Uchimura, Keiichi
    Koutaki, Gou
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2015, 11 (05): : 1509 - 1523
  • [45] Gaussian process regression: Optimality, robustness, and relationship with kernel ridge regression
    Wang, Wenjia
    Jing, Bing-Yi
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23 : 1 - 67
  • [46] Scalable Deep Kernel Gaussian Process for Vehicle Dynamics in Autonomous Racing
    Ning, Jingyun
    Behl, Madhur
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [47] REPRODUCING KERNEL HILBERT SPACE STRUCTURE OF SAMPLE PATHS OF A GAUSSIAN PROCESS
    DRISCOLL, MF
    ZEITSCHRIFT FUR WAHRSCHEINLICHKEITSTHEORIE UND VERWANDTE GEBIETE, 1973, 26 (04): : 309 - 316
  • [48] Gaussian Process Surrogate Model with Composite Kernel Learning for Engineering Design
    Palar, Pramudita Satria
    Zuhal, Lavi Rizki
    Shimoyama, Koji
    AIAA JOURNAL, 2020, 58 (04) : 1864 - 1880
  • [49] Spectrum-Based Kernel Length Estimation for Gaussian Process Classification
    Wang, Liang
    Li, Chuan
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (06) : 805 - 816
  • [50] Sensor Reading Prediction using Anisotropic Kernel Gaussian Process Regression
    Jannah, Erliyah Nurul
    Pao, Hsing-Kuo
    2014 IEEE INTERNATIONAL CONFERENCE (ITHINGS) - 2014 IEEE INTERNATIONAL CONFERENCE ON GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) - 2014 IEEE INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL-SOCIAL COMPUTING (CPS), 2014, : 207 - 214