Efficient estimates in regression models with highly correlated covariates

被引:2
|
作者
Koukouvinos, Christos [1 ]
Mitrouli, Marilena [2 ]
Turek, Ondrej [3 ,4 ]
机构
[1] Natl Tech Univ Athens, Dept Math, Athens 15773, Greece
[2] Natl & Kapodistrian Univ Athens, Dept Math, Athens 15784, Greece
[3] Univ Ostrava, Fac Sci, Dept Math, CZ-70103 Ostrava, Czech Republic
[4] Czech Acad Sci, Nucl Phys Inst, Rez 25068, Czech Republic
关键词
Penalized least squares; Tuning parameter; Extrapolation; Generalized cross-validation; REGULARIZATION;
D O I
10.1016/j.cam.2019.112416
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The specification of accurate ridge estimates in penalized regression models strongly depends on the appropriate choice of the tuning parameter which monitors the regularization process. In this work, we propose the selection of this parameter via the minimization of an extrapolation estimate of the generalized cross-validation function. The efficiency of the estimate is characterized by an appropriately defined index of proximity; in case that its value approaches one, the estimation becomes optimal. We consider regression models with highly correlated covariates and prove that the probability of the index of proximity being close to one is high. This result is confirmed through several simulation tests. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Marginal hazard regression for correlated failure time data with auxiliary covariates
    Liu, Yanyan
    Yuan, Zhongshang
    Cai, Jianwen
    Zhou, Haibo
    LIFETIME DATA ANALYSIS, 2012, 18 (01) : 116 - 138
  • [22] Regression analysis of overdispersed correlated count data with subject specific covariates
    Solis-Trapala, IL
    Farewell, VT
    STATISTICS IN MEDICINE, 2005, 24 (16) : 2557 - 2575
  • [23] Marginal hazard regression for correlated failure time data with auxiliary covariates
    Yanyan Liu
    Zhongshang Yuan
    Jianwen Cai
    Haibo Zhou
    Lifetime Data Analysis, 2012, 18 : 116 - 138
  • [24] PARAMETER ESTIMATES IN REGRESSION MODELS
    LEVADI, VS
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1964, AC 9 (04) : 589 - &
  • [25] Conditional and unconditional categorical regression models with missing covariates
    Satten, GA
    Carroll, RJ
    BIOMETRICS, 2000, 56 (02) : 384 - 388
  • [26] Inference in Linear Regression Models with Many Covariates and Heteroscedasticity
    Cattaneo, Matias D.
    Jansson, Michael
    Newey, Whitney K.
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2018, 113 (523) : 1350 - 1361
  • [27] Spherical regression models with general covariates and anisotropic errors
    P. J. Paine
    S. P. Preston
    M. Tsagris
    Andrew T. A. Wood
    Statistics and Computing, 2020, 30 : 153 - 165
  • [28] Cox regression models with functional covariates for survival data
    Gellar, Jonathan E.
    Colantuoni, Elizabeth
    Needham, Dale M.
    Crainiceanu, Ciprian M.
    STATISTICAL MODELLING, 2015, 15 (03) : 256 - 278
  • [29] A conditional model for incomplete covariates in parametric regression models
    Lipsitz, SR
    Ibrahim, JG
    BIOMETRIKA, 1996, 83 (04) : 916 - 922
  • [30] Spherical regression models with general covariates and anisotropic errors
    Paine, P. J.
    Preston, P.
    Tsagris, M.
    Wood, Andrew T. A.
    STATISTICS AND COMPUTING, 2020, 30 (01) : 153 - 165