A mixed-categorical correlation kernel for Gaussian process

被引:6
|
作者
Saves, P. [1 ,2 ]
Diouane, Y. [3 ]
Bartoli, N. [1 ]
Lefebvre, T. [1 ]
Morlier, J. [4 ]
机构
[1] Univ Toulouse, ONERA, DTIS, F-31055 Toulouse, France
[2] Univ Toulouse, ISAE SUPAERO, F-31055 Toulouse 4, France
[3] Polytech Montreal, Montreal, PQ, Canada
[4] Univ Toulouse, Inst Clement Ader ICA, ISAE SUPAERO, Mines Albi,UPS,INSA,CNRS, 3 Rue Caroline Aigle, F-31400 Toulouse, France
基金
欧盟地平线“2020”;
关键词
Gaussian process; Mixed-categorical; Continuous relaxation; Hypersphere decomposition; Bayesian optimization; Surrogate modeling toolbox; OPTIMIZATION; REGRESSION; MODELS;
D O I
10.1016/j.neucom.2023.126472
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian pro-cess (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estima-tion of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surro-gate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] High-dimensional mixed-categorical Gaussian processes with application to multidisciplinary design optimization for a green aircraft
    Saves, Paul
    Diouane, Youssef
    Bartoli, Nathalie
    Lefebvre, Thierry
    Morlier, Joseph
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2024, 67 (05)
  • [2] EDMD: An Entropy based Dissimilarity measure to cluster Mixed-categorical Data
    Kar, Amit Kumar
    Akhter, Mohammad Maksood
    Mishra, Amaresh Chandra
    Mohanty, Sraban Kumar
    PATTERN RECOGNITION, 2024, 155
  • [3] Global optimization for mixed categorical-continuous variables based on Gaussian process models with a randomized categorical space exploration step
    Zuniga, Miguel Munoz
    Sinoquet, Delphine
    INFOR, 2020, 58 (02) : 310 - 341
  • [4] Mixed-input Gaussian process emulators for computer experiments with a large number of categorical levels
    Zhang, Qiong
    Chien, Peter
    Liu, Qing
    Xu, Li
    Hong, Yili
    JOURNAL OF QUALITY TECHNOLOGY, 2021, 53 (04) : 410 - 420
  • [5] Classification and Categorical Inputs with Treed Gaussian Process Models
    Tamara Broderick
    Robert B. Gramacy
    Journal of Classification, 2011, 28 : 244 - 270
  • [6] Group Kernels for Gaussian Process Metamodels with Categorical Inputs
    Roustant, Olivier
    Padonou, Esperan
    Deville, Yves
    Clement, Alois
    Perrin, Guillaume
    Giorla, Jean
    Wynn, Henry
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2020, 8 (02): : 775 - 806
  • [7] Classification and Categorical Inputs with Treed Gaussian Process Models
    Broderick, Tamara
    Gramacy, Robert B.
    JOURNAL OF CLASSIFICATION, 2011, 28 (02) : 244 - 270
  • [8] Latent Gaussian process for anomaly detection in categorical data
    Lv, Fengmao
    Liang, Tao
    Zhao, Jiayi
    Zhuo, Zhongliu
    Wu, Jinzhao
    Yang, Guowu
    KNOWLEDGE-BASED SYSTEMS, 2021, 220
  • [9] Improving Gaussian process with quantum kernel estimation
    Zhou, Xiaojian
    Cui, Qi
    Zhang, Meng
    Jiang, Ting
    QUANTUM INFORMATION PROCESSING, 2025, 24 (02)
  • [10] Sparse Inverse Kernel Gaussian Process Regression
    Das, Kamalika
    Srivastava, Ashok N.
    STATISTICAL ANALYSIS AND DATA MINING, 2013, 6 (03) : 205 - 220