Prediction error criterion for selecting variables in a linear regression model

被引:6
|
作者
Fujikoshi, Yasunori [1 ]
Kan, Tamio [2 ]
Takahashi, Shin [2 ]
Sakurai, Tetsuro [1 ]
机构
[1] Chuo Univ, Dept Math, Grad Sch Sci & Engn, Bunkyo Ku, Tokyo 1128551, Japan
[2] Esumi Co Ltd, Nakano Ku, Tokyo 1640012, Japan
关键词
Prediction error criterion; Linear regression models; Selection of variables; Risk function; Selection criteria; C-P;
D O I
10.1007/s10463-009-0233-5
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Several criteria, such as CV, C (p) , AIC, CAIC, and MAIC, are used for selecting variables in linear regression models. It might be noted that C (p) has been proposed as an estimator of the expected standardized prediction error, although the target risk function of CV might be regarded as the expected prediction error R (PE). On the other hand, the target risk function of AIC, CAIC, and MAIC is the expected log-predictive likelihood. In this paper, we propose a prediction error criterion, PE, which is an estimator of the expected prediction error R (PE). Consequently, it is also a competitor of CV. Results of this study show that PE is an unbiased estimator when the true model is contained in the full model. The property is shown without the assumption of normality. In fact, PE is demonstrated as more faithful for its risk function than CV. The prediction error criterion PE is extended to the multivariate case. Furthermore, using simulations, we examine some peculiarities of all these criteria.
引用
收藏
页码:387 / 403
页数:17
相关论文
共 50 条
  • [11] Relative squared error prediction in the generalized linear regression model
    Bernhard F. Arnold
    Peter Stahlecker
    Statistical Papers, 2003, 44 : 107 - 115
  • [12] ERROR-IN-VARIABLES AND LINEAR-REGRESSION
    MARQUESVIDAL, P
    RAKOTOVAO, R
    DUCIMETIERE, P
    REVUE D EPIDEMIOLOGIE ET DE SANTE PUBLIQUE, 1994, 42 (01): : 58 - 67
  • [13] On prediction error in functional linear regression
    Apanasovich, Tatiyana V.
    Goldstein, Edward
    STATISTICS & PROBABILITY LETTERS, 2008, 78 (13) : 1807 - 1810
  • [14] SELECTING IMPORTANT INDEPENDENT VARIABLES IN LINEAR-REGRESSION MODELS
    GUPTA, SS
    HUANG, DY
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1988, 20 (02) : 155 - 167
  • [15] Prediction error bounds for linear regression with the TREX
    Jacob Bien
    Irina Gaynanova
    Johannes Lederer
    Christian L. Müller
    TEST, 2019, 28 : 451 - 474
  • [16] Prediction error bounds for linear regression with the TREX
    Bien, Jacob
    Gaynanova, Irina
    Lederer, Johannes
    Mueller, Christian L.
    TEST, 2019, 28 (02) : 451 - 474
  • [17] A TEST OF MEAN SQUARE ERROR CRITERION FOR RESTRICTIONS IN LINEAR REGRESSION
    TOROVIZCARRONDO, C
    WALLACE, TD
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1968, 63 (322) : 558 - 572
  • [18] LINEAR PREDICTION OF SPEECH WITH A LEAST ABSOLUTE ERROR CRITERION
    DENOEL, E
    SOLVAY, JP
    IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1985, 33 (06): : 1397 - 1403
  • [20] Optimal non-diagonal-type estimators in linear regression under the prediction error sum of squares criterion
    Rong, Jian-Ying
    Liu, Xu-Qing
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (03) : 2418 - 2429