Penalized Regression with Ordinal Predictors

被引:53
|
作者
Gertheiss, Jan [1 ]
Tutz, Gerhard [1 ]
机构
[1] Univ Munich, D-80799 Munich, Germany
关键词
Basis function approach; classical linear model; dummy coding; generalized linear models; generalized ridge regression; ordinal predictors; penalized likelihood estimation; RANK ORDER CATEGORIES; RIDGE-REGRESSION; MODELS; ASSIGNMENT; VARIABLES; NUMBERS;
D O I
10.1111/j.1751-5823.2009.00088.x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
P>Ordered categorial predictors are a common case in regression modelling. In contrast to the case of ordinal response variables, ordinal predictors have been largely neglected in the literature. In this paper, existing methods are reviewed and the use of penalized regression techniques is proposed. Based on dummy coding two types of penalization are explicitly developed; the first imposes a difference penalty, the second is a ridge type refitting procedure. Also a Bayesian motivation is provided. The concept is generalized to the case of non-normal outcomes within the framework of generalized linear models by applying penalized likelihood estimation. Simulation studies and real world data serve for illustration and to compare the approaches to methods often seen in practice, namely simple linear regression on the group labels and pure dummy coding. Especially the proposed difference penalty turns out to be highly competitive.
引用
收藏
页码:345 / 365
页数:21
相关论文
共 50 条
  • [41] Bootstrapping for Penalized Spline Regression
    Kauermann, Goeran
    Claeskens, Gerda
    Opsomer, J. D.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2009, 18 (01) : 126 - 146
  • [42] SORTED CONCAVE PENALIZED REGRESSION
    Feng, Long
    Zhang, Cun-Hui
    ANNALS OF STATISTICS, 2019, 47 (06): : 3069 - 3098
  • [43] Group penalized expectile regression
    Ouhourane, Mohamed
    Oualkacha, Karim
    Yang, Archer Yi
    STATISTICAL METHODS AND APPLICATIONS, 2024,
  • [44] Penalized wavelet monotone regression
    Antoniadis, Anestis
    Bigot, Jeremie
    Gijbels, Irene
    STATISTICS & PROBABILITY LETTERS, 2007, 77 (16) : 1608 - 1621
  • [45] Convolutional Ordinal Regression Forest for Image Ordinal Estimation
    Zhu, Haiping
    Shan, Hongming
    Zhang, Yuheng
    Che, Lingfu
    Xu, Xiaoyang
    Zhang, Junping
    Shi, Jianbo
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 4084 - 4095
  • [47] Ordinal Regression with Sparse Bayesian
    Chang, Xiao
    Zheng, Qinghua
    Lin, Peng
    EMERGING INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS: WITH ASPECTS OF ARTIFICIAL INTELLIGENCE, 2009, 5755 : 591 - 599
  • [48] Soft Labels for Ordinal Regression
    Diaz, Raul
    Marathe, Amit
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4733 - 4742
  • [49] Gaussian processes for ordinal regression
    Chu, W
    Ghahramani, Z
    JOURNAL OF MACHINE LEARNING RESEARCH, 2005, 6 : 1019 - 1041
  • [50] Regression Models for Ordinal Outcomes
    French, Benjamin
    Shotwell, Matthew S.
    JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2022, 328 (08): : 772 - 773