Penalized Regression with Ordinal Predictors

被引:53
|
作者
Gertheiss, Jan [1 ]
Tutz, Gerhard [1 ]
机构
[1] Univ Munich, D-80799 Munich, Germany
关键词
Basis function approach; classical linear model; dummy coding; generalized linear models; generalized ridge regression; ordinal predictors; penalized likelihood estimation; RANK ORDER CATEGORIES; RIDGE-REGRESSION; MODELS; ASSIGNMENT; VARIABLES; NUMBERS;
D O I
10.1111/j.1751-5823.2009.00088.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
P>Ordered categorial predictors are a common case in regression modelling. In contrast to the case of ordinal response variables, ordinal predictors have been largely neglected in the literature. In this paper, existing methods are reviewed and the use of penalized regression techniques is proposed. Based on dummy coding two types of penalization are explicitly developed; the first imposes a difference penalty, the second is a ridge type refitting procedure. Also a Bayesian motivation is provided. The concept is generalized to the case of non-normal outcomes within the framework of generalized linear models by applying penalized likelihood estimation. Simulation studies and real world data serve for illustration and to compare the approaches to methods often seen in practice, namely simple linear regression on the group labels and pure dummy coding. Especially the proposed difference penalty turns out to be highly competitive.
引用
收藏
页码:345 / 365
页数:21
相关论文
共 50 条
  • [31] PENALIZED LIKELIHOOD FUNCTIONAL REGRESSION
    Du, Pang
    Wang, Xiao
    STATISTICA SINICA, 2014, 24 (02) : 1017 - 1041
  • [32] Hierarchically penalized quantile regression
    Kang, Jongkyeong
    Bang, Sungwan
    Jhun, Myoungshic
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2016, 86 (02) : 340 - 356
  • [33] Group penalized quantile regression
    Ouhourane, Mohamed
    Yang, Yi
    Benedet, Andrea L.
    Oualkacha, Karim
    STATISTICAL METHODS AND APPLICATIONS, 2022, 31 (03): : 495 - 529
  • [34] Group penalized quantile regression
    Mohamed Ouhourane
    Yi Yang
    Andréa L. Benedet
    Karim Oualkacha
    Statistical Methods & Applications, 2022, 31 : 495 - 529
  • [35] PENALIZED LIKELIHOOD IN COX REGRESSION
    VERWEIJ, PJM
    VANHOUWELINGEN, HC
    STATISTICS IN MEDICINE, 1994, 13 (23-24) : 2427 - 2436
  • [36] Quadratic Programming and Penalized Regression
    Smith, Andrew D. A. C.
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2013, 42 (07) : 1363 - 1372
  • [37] Compressed and Penalized Linear Regression
    Homrighausen, Darren
    McDonald, Daniel J.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2020, 29 (02) : 309 - 322
  • [38] Topologically penalized regression on manifolds
    Hacquard, Olympio
    Balasubramanian, Krishnakumar
    Blanchard, Gilles
    Levrard, Clement
    Polonik, Wolfgang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [39] Penalized quantile regression tree
    Kim, Jaeoh
    Cho, HyungJun
    Bang, Sungwan
    KOREAN JOURNAL OF APPLIED STATISTICS, 2016, 29 (07) : 1361 - 1371
  • [40] Multidimensional penalized signal regression
    Marx, BD
    Eilers, PHC
    TECHNOMETRICS, 2005, 47 (01) : 13 - 22