Penalized Regression with Ordinal Predictors

被引:53
|
作者
Gertheiss, Jan [1 ]
Tutz, Gerhard [1 ]
机构
[1] Univ Munich, D-80799 Munich, Germany
关键词
Basis function approach; classical linear model; dummy coding; generalized linear models; generalized ridge regression; ordinal predictors; penalized likelihood estimation; RANK ORDER CATEGORIES; RIDGE-REGRESSION; MODELS; ASSIGNMENT; VARIABLES; NUMBERS;
D O I
10.1111/j.1751-5823.2009.00088.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
P>Ordered categorial predictors are a common case in regression modelling. In contrast to the case of ordinal response variables, ordinal predictors have been largely neglected in the literature. In this paper, existing methods are reviewed and the use of penalized regression techniques is proposed. Based on dummy coding two types of penalization are explicitly developed; the first imposes a difference penalty, the second is a ridge type refitting procedure. Also a Bayesian motivation is provided. The concept is generalized to the case of non-normal outcomes within the framework of generalized linear models by applying penalized likelihood estimation. Simulation studies and real world data serve for illustration and to compare the approaches to methods often seen in practice, namely simple linear regression on the group labels and pure dummy coding. Especially the proposed difference penalty turns out to be highly competitive.
引用
收藏
页码:345 / 365
页数:21
相关论文
共 50 条
  • [21] Ordinal logistic regression
    Warner, Pamela
    JOURNAL OF FAMILY PLANNING AND REPRODUCTIVE HEALTH CARE, 2008, 34 (03): : 169 - 170
  • [22] Ordinal Choquistic Regression
    Tehrani, Ali Fallah
    Huellermeier, Eyke
    PROCEEDINGS OF THE 8TH CONFERENCE OF THE EUROPEAN SOCIETY FOR FUZZY LOGIC AND TECHNOLOGY (EUSFLAT-13), 2013, 32 : 802 - 809
  • [23] Ordinal logistic regression
    Koletsi, Despina
    Pandis, Nikolaos
    AMERICAN JOURNAL OF ORTHODONTICS AND DENTOFACIAL ORTHOPEDICS, 2018, 153 (01) : 157 - 158
  • [24] ORDINAL REGRESSION - COMMENT
    MACDONALD, KI
    AMERICAN SOCIOLOGICAL REVIEW, 1973, 38 (04) : 494 - 495
  • [25] Transductive Ordinal Regression
    Seah, Chun-Wei
    Tsang, Ivor W.
    Ong, Yew-Soon
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (07) : 1074 - 1086
  • [26] A penalized estimation for the Cox model with ordinal multinomial covariates
    Yue, Chao
    Xuejun, Ma
    Yaguang, Li
    Lei, Huang
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2022, 92 (06) : 1194 - 1223
  • [27] Bayesian bridge-randomized penalized quantile regression for ordinal longitudinal data, with application to firm's bond ratings
    Tian, Yu-Zhu
    Tang, Man-Lai
    Chan, Wai-Sum
    Tian, Mao-Zai
    COMPUTATIONAL STATISTICS, 2021, 36 (02) : 1289 - 1319
  • [28] Bayesian bridge-randomized penalized quantile regression for ordinal longitudinal data, with application to firm’s bond ratings
    Yu-Zhu Tian
    Man-Lai Tang
    Wai-Sum Chan
    Mao-Zai Tian
    Computational Statistics, 2021, 36 : 1289 - 1319
  • [29] BIVARIATE PENALIZED SPLINES FOR REGRESSION
    Lai, Ming-Jun
    Wang, Li
    STATISTICA SINICA, 2013, 23 (03) : 1399 - 1417
  • [30] Penalized Euclidean distance regression
    Vasiliu, Daniel
    Dey, Tanujit
    Dryden, Ian L.
    STAT, 2018, 7 (01):