Decision boundaries for mixtures of regressions

被引:19
|
作者
Ingrassia, Salvatore [1 ]
Punzo, Antonio [1 ]
机构
[1] Univ Catania, Dept Econ & Business, Cso Italia 55, I-95129 Catania, Italy
关键词
Decision boundary; Discriminant analysis; Hyperquadrics; Mixtures of regressions; Model-based clustering; FINITE MIXTURES; CONCOMITANT VARIABLES; MAXIMUM-LIKELIHOOD;
D O I
10.1016/j.jkss.2015.11.005
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The analysis of the decision boundaries plays an important role in understanding the characteristics of a classifier in the framework of model-based clustering and discriminant analysis. The wider is the family of decision boundaries generated by a classifier the larger is its flexibility for classification purposes. In this paper, we present rigorous results concerning the decision boundaries of mixtures of (linear) regressions under Gaussian assumptions. In particular, three types of mixtures of regressions are considered: with fixed covariates, with concomitant variables, and with random covariates. The obtained decision boundaries have a geometrical interpretation in terms hyperquadrics and define a taxonomy of the considered models. Beyond Gaussian assumptions, decision boundaries can be investigated numerically; as an example, we illustrate the case of the t distribution. (C) 2015 The Korean Statistical Society. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [41] Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition
    Salvatore Ingrassia
    Antonio Punzo
    Journal of Classification, 2020, 37 : 526 - 547
  • [42] Online Bayesian learning for mixtures of spatial spline regressions with mixed effects
    Ge, Shufei
    Wang, Shijia
    Nathoo, Farouk S.
    Wang, Liangliang
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2022, 92 (07) : 1530 - 1566
  • [43] Screening and clustering of sparse regressions with finite non-Gaussian mixtures
    Zhang, Jian
    BIOMETRICS, 2017, 73 (02) : 540 - 550
  • [44] Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes
    Yin, Dong
    Pedarsani, Ramtin
    Chen, Yudong
    Ramchandran, Kannan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (03) : 1430 - 1451
  • [45] Semiparametric mixtures of regressions with single-index for model based clustering
    Xiang, Sijia
    Yao, Weixin
    ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2020, 14 (02) : 261 - 292
  • [46] Population based multivariate mixtures of logistic regressions: Infant mortality.
    Gage, TB
    AMERICAN JOURNAL OF HUMAN BIOLOGY, 2003, 15 (02) : 261 - 261
  • [47] Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments
    Chen, Sitan
    Li, Jerry
    Song, Zhao
    PROCEEDINGS OF THE 52ND ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '20), 2020, : 587 - 600
  • [48] Learning Mixtures of Sparse Linear Regressions Using Sparse Graph Codes
    Yin, Dong
    Pedarsani, Ramtin
    Chen, Yudong
    Ramchandran, Kannan
    2017 55TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2017, : 588 - 595
  • [49] Finite Mixtures of Mean-Parameterized Conway–Maxwell–Poisson Regressions
    Dongying Zhan
    Derek S. Young
    Journal of Statistical Theory and Practice, 2024, 18
  • [50] Cluster Validation for Mixtures of Regressions via the Total Sum of Squares Decomposition
    Ingrassia, Salvatore
    Punzo, Antonio
    JOURNAL OF CLASSIFICATION, 2020, 37 (02) : 526 - 547