Variance estimation for high-dimensional regression models

被引:31
|
作者
Spokoiny, V [1 ]
机构
[1] Weierstr Inst Appl Anal & Stochast, Berlin, Germany
关键词
variance estimation; regression; high dimension;
D O I
10.1006/jmva.2001.2023
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The paper is concerned with the problem of variance estimation for a high-dimensional regression model. The results show that the accuracy n(-1/2) of variance estimation can be achieved only under some restrictions on smoothness properties of the regression function and on the dimensionality of the model. In particular, for a two times differentiable regression function, the rate n(-1/2) is achievable only for dimensionality smaller or equal to 8. For a higher dimensional model, the optimal accuracy is n(-4/d) which is worse than n(-1/2). The rate optimal estimating procedure is presented. (C) 2001 Elsevier Science (USA).
引用
收藏
页码:111 / 133
页数:23
相关论文
共 50 条
  • [41] Dynamic Shrinkage Estimation of the High-Dimensional Minimum-Variance Portfolio
    Bodnar, Taras
    Parolya, Nestor
    Thorsen, Erik
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 1334 - 1349
  • [42] DOUBLY PENALIZED ESTIMATION IN ADDITIVE REGRESSION WITH HIGH-DIMENSIONAL DATA
    Tan, Zhiqiang
    Zhang, Cun-Hui
    ANNALS OF STATISTICS, 2019, 47 (05): : 2567 - 2600
  • [43] Oracle Estimation of a Change Point in High-Dimensional Quantile Regression
    Lee, Sokbae
    Liao, Yuan
    Seo, Myung Hwan
    Shin, Youngki
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2018, 113 (523) : 1184 - 1194
  • [44] HEAD POSE ESTIMATION VIA PROBABILISTIC HIGH-DIMENSIONAL REGRESSION
    Drouard, Vincent
    Ba, Sileye
    Evangelidis, Georgios
    Deleforge, Antoine
    Horaud, Radu
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 4624 - 4628
  • [45] High-dimensional properties for empirical priors in linear regression with unknown error variance
    Fang, Xiao
    Ghosh, Malay
    STATISTICAL PAPERS, 2024, 65 (01) : 237 - 262
  • [46] High-dimensional properties for empirical priors in linear regression with unknown error variance
    Xiao Fang
    Malay Ghosh
    Statistical Papers, 2024, 65 : 237 - 262
  • [47] Consistent Risk Estimation in Moderately High-Dimensional Linear Regression
    Xu, Ji
    Maleki, Arian
    Rad, Kamiar Rahnama
    Hsu, Daniel
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2021, 67 (09) : 5997 - 6030
  • [48] On variance estimation in semiparametric regression models
    Cheng, FX
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2005, 34 (08) : 1737 - 1742
  • [49] Shrinkage and Sparse Estimation for High-Dimensional Linear Models
    Asl, M. Noori
    Bevrani, H.
    Belaghi, R. Arabi
    Ahmed, Syed Ejaz
    PROCEEDINGS OF THE THIRTEENTH INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, VOL 1, 2020, 1001 : 147 - 156
  • [50] Noise Level Estimation in High-Dimensional Linear Models
    G. K. Golubev
    E. A. Krymova
    Problems of Information Transmission, 2018, 54 : 351 - 371