Efficient estimates in regression models with highly correlated covariates

被引:2
|
作者
Koukouvinos, Christos [1 ]
Mitrouli, Marilena [2 ]
Turek, Ondrej [3 ,4 ]
机构
[1] Natl Tech Univ Athens, Dept Math, Athens 15773, Greece
[2] Natl & Kapodistrian Univ Athens, Dept Math, Athens 15784, Greece
[3] Univ Ostrava, Fac Sci, Dept Math, CZ-70103 Ostrava, Czech Republic
[4] Czech Acad Sci, Nucl Phys Inst, Rez 25068, Czech Republic
关键词
Penalized least squares; Tuning parameter; Extrapolation; Generalized cross-validation; REGULARIZATION;
D O I
10.1016/j.cam.2019.112416
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The specification of accurate ridge estimates in penalized regression models strongly depends on the appropriate choice of the tuning parameter which monitors the regularization process. In this work, we propose the selection of this parameter via the minimization of an extrapolation estimate of the generalized cross-validation function. The efficiency of the estimate is characterized by an appropriately defined index of proximity; in case that its value approaches one, the estimation becomes optimal. We consider regression models with highly correlated covariates and prove that the probability of the index of proximity being close to one is high. This result is confirmed through several simulation tests. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Development of nonlinear regression models for covariates with measurement errors.
    Young, D
    Piscitelli, DA
    Bigora, S
    CLINICAL PHARMACOLOGY & THERAPEUTICS, 1997, 61 (02) : PII84 - PII84
  • [42] Forward regression for Cox models with high-dimensional covariates
    Hong, Hyokyoung G.
    Zheng, Qi
    Li, Yi
    JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 173 : 268 - 290
  • [43] Selecting Spatial Scale of Covariates in Regression Models of Environmental Exposures
    Grant, Lauren P.
    Gennings, Chris
    Wheeler, David C.
    CANCER INFORMATICS, 2015, 14 : 81 - 96
  • [44] Single index regression models in the presence of censoring depending on the covariates
    Lopez, Olivier
    Patilea, Valentin
    Van Keilegom, Ingrid
    BERNOULLI, 2013, 19 (03) : 721 - 747
  • [45] Monitoring and diagnosing batch processes with multiway covariates regression models
    Boqué, R
    Smilde, AK
    AICHE JOURNAL, 1999, 45 (07) : 1504 - 1520
  • [46] Time-varying covariates and coefficients in Cox regression models
    Zhang, Zhongheng
    Reinikainen, Jaakko
    Adeleke, Kazeem Adedayo
    Pieterse, Marcel E.
    Groothuis-Oudshoorn, Catharina G. M.
    ANNALS OF TRANSLATIONAL MEDICINE, 2018, 6 (07)
  • [47] Regression models for linkage: Issues of traits, covariates, heterogeneity, and interaction
    Schaid, DJ
    Olson, JM
    Gauderman, WJ
    Elston, RC
    HUMAN HEREDITY, 2003, 55 (2-3) : 86 - 96
  • [48] Imputation and variable selection in linear regression models with missing covariates
    Yang, XW
    Belin, TR
    Boscardin, WJ
    BIOMETRICS, 2005, 61 (02) : 498 - 506
  • [49] High-Dimensional Gaussian Graphical Regression Models with Covariates
    Zhang, Jingfei
    Li, Yi
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (543) : 2088 - 2100
  • [50] Understanding the Cox regression models with time-change covariates
    Zhou, M
    AMERICAN STATISTICIAN, 2001, 55 (02): : 153 - 155