A mixed-categorical correlation kernel for Gaussian process

被引:6
|
作者
Saves, P. [1 ,2 ]
Diouane, Y. [3 ]
Bartoli, N. [1 ]
Lefebvre, T. [1 ]
Morlier, J. [4 ]
机构
[1] Univ Toulouse, ONERA, DTIS, F-31055 Toulouse, France
[2] Univ Toulouse, ISAE SUPAERO, F-31055 Toulouse 4, France
[3] Polytech Montreal, Montreal, PQ, Canada
[4] Univ Toulouse, Inst Clement Ader ICA, ISAE SUPAERO, Mines Albi,UPS,INSA,CNRS, 3 Rue Caroline Aigle, F-31400 Toulouse, France
基金
欧盟地平线“2020”;
关键词
Gaussian process; Mixed-categorical; Continuous relaxation; Hypersphere decomposition; Bayesian optimization; Surrogate modeling toolbox; OPTIMIZATION; REGRESSION; MODELS;
D O I
10.1016/j.neucom.2023.126472
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian pro-cess (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estima-tion of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surro-gate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] An Interpretable and Sample Efficient Deep Kernel for Gaussian Process
    Dai, Yijue
    Zhang, Tianjian
    Lin, Zhidi
    Yin, Feng
    Theodoridis, Sergios
    Cui, Shuguang
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020), 2020, 124 : 759 - 768
  • [22] Gaussian Process with Graph Convolutional Kernel for Relational Learning
    Fang, Jinyuan
    Liang, Shangsong
    Meng, Zaiqiao
    Zhang, Qiang
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 353 - 363
  • [23] Human Action Recognition with DeepAction Kernel Gaussian Process
    Wang, Yali
    Li, Lin
    Qiao, Yu
    IEEE ICARM 2016 - 2016 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM), 2016, : 165 - 170
  • [24] Understanding Gaussian process regression using the equivalent kernel
    Sollich, P
    Williams, CKI
    DETERMINISTIC AND STATISTICAL METHODS IN MACHINE LEARNING, 2005, 3635 : 211 - 228
  • [25] The Near Constant Acceleration Gaussian Process Kernel for Tracking
    Reece, Steven
    Roberts, Stephen
    IEEE SIGNAL PROCESSING LETTERS, 2010, 17 (08) : 707 - 710
  • [26] Articulated and Generalized Gaussian Kernel Correlation for Human Pose Estimation
    Ding, Meng
    Fan, Guoliang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (02) : 776 - 789
  • [27] Improved Kernel Correlation Filter Tracking with Gaussian scale space
    Tan, Shukun
    Liu, Yunpeng
    Li, Yicui
    INFRARED TECHNOLOGY AND APPLICATIONS, AND ROBOT SENSING AND ADVANCED CONTROL, 2016, 10157
  • [28] Gaussian Process Regression with Categorical Inputs for Predicting the Blood Glucose Level
    Tomczak, Jakub M.
    ADVANCES IN SYSTEMS SCIENCE, ICSS 2016, 2017, 539 : 98 - 108
  • [29] Generative classification model for categorical data based on latent Gaussian process
    Lv, Fengmao
    Yang, Guowu
    Zhu, William
    Liu, Chuan
    PATTERN RECOGNITION LETTERS, 2017, 92 : 56 - 61
  • [30] Dimensionality reduction by Mixed Kernel Canonical Correlation Analysis
    Zhu, Xiaofeng
    Huang, Zi
    Shen, Heng Tao
    Cheng, Jian
    Xu, Changsheng
    PATTERN RECOGNITION, 2012, 45 (08) : 3003 - 3016