Efficient estimates in regression models with highly correlated covariates

被引:2
|
作者
Koukouvinos, Christos [1 ]
Mitrouli, Marilena [2 ]
Turek, Ondrej [3 ,4 ]
机构
[1] Natl Tech Univ Athens, Dept Math, Athens 15773, Greece
[2] Natl & Kapodistrian Univ Athens, Dept Math, Athens 15784, Greece
[3] Univ Ostrava, Fac Sci, Dept Math, CZ-70103 Ostrava, Czech Republic
[4] Czech Acad Sci, Nucl Phys Inst, Rez 25068, Czech Republic
关键词
Penalized least squares; Tuning parameter; Extrapolation; Generalized cross-validation; REGULARIZATION;
D O I
10.1016/j.cam.2019.112416
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The specification of accurate ridge estimates in penalized regression models strongly depends on the appropriate choice of the tuning parameter which monitors the regularization process. In this work, we propose the selection of this parameter via the minimization of an extrapolation estimate of the generalized cross-validation function. The efficiency of the estimate is characterized by an appropriately defined index of proximity; in case that its value approaches one, the estimation becomes optimal. We consider regression models with highly correlated covariates and prove that the probability of the index of proximity being close to one is high. This result is confirmed through several simulation tests. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条