Sparse estimation in high-dimensional linear errors-in-variables regression via a covariate relaxation method

被引:0
|
作者
Li, Xin [1 ]
Wu, Dongya [2 ]
机构
[1] Northwest Univ, Sch Math, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
[2] Northwest Univ, Sch Informat Sci & Technol, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse recovery; Errors-in-variables model; Covariate relaxation; Statistical consistency; MINIMAX RATES; SELECTION;
D O I
10.1007/s11222-023-10312-5
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Sparse signal recovery in high-dimensional settings via regularization techniques has been developed in the past two decades and produces fruitful results in various areas. Previous studies mainly focus on the idealized assumption where covariates are free of noise. However, in realistic scenarios, covariates are always corrupted by measurement errors, which may induce significant estimation bias when methods for clean data are naively applied. Recent studies begin to deal with the errors-in-variables models. Current method either depends on the distribution of covariate noise or does not depends on the distribution but is inconsistent in parameter estimation. A novel covariate relaxation method that does not depend on the distribution of covariate noise is proposed. Statistical consistency on parameter estimation is established. Numerical experiments are conducted and show that the covariate relaxation method achieves the same or even better estimation accuracy than that of the state of art nonconvex Lasso estimator. The advantage that the covariate relaxation method is independent of the distribution of covariate noise while produces a small estimation error suggests its prospect in practical applications.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Estimation in Linear Models with Random Effects and Errors-in-Variables
    Xu-Ping Zhong
    Wing-Kam Fung
    Bo-Cheng Wei
    Annals of the Institute of Statistical Mathematics, 2002, 54 : 595 - 606
  • [32] Estimation in linear models with random effects and errors-in-variables
    Zhong, XP
    Fung, WK
    Wei, BC
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2002, 54 (03) : 595 - 606
  • [33] Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
    Ray, Kolyan
    Szabo, Botond
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2022, 117 (539) : 1270 - 1281
  • [34] Empirical Priors for Prediction in Sparse High-dimensional Linear Regression
    Martin, Ryan
    Tang, Yiqi
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [35] Empirical priors for prediction in sparse high-dimensional linear regression
    Martin, Ryan
    Tang, Yiqi
    Journal of Machine Learning Research, 2020, 21
  • [36] Method of Moments Estimation in Linear Regression with Errors in both Variables
    Gillard, Jonathan
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2014, 43 (15) : 3208 - 3222
  • [37] Smoothing splines estimators in functional linear regression with errors-in-variables
    Cardot, Herve
    Crambes, Christophe
    Kneip, Alois
    Sarda, Pascal
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 51 (10) : 4832 - 4848
  • [38] The use and misuse of orthogonal regression in linear errors-in-variables models
    Carroll, RJ
    Ruppert, D
    AMERICAN STATISTICIAN, 1996, 50 (01): : 1 - 6
  • [39] A STEPWISE REGRESSION METHOD AND CONSISTENT MODEL SELECTION FOR HIGH-DIMENSIONAL SPARSE LINEAR MODELS
    Ing, Ching-Kang
    Lai, Tze Leung
    STATISTICA SINICA, 2011, 21 (04) : 1473 - 1513
  • [40] Robust Estimation of High-Dimensional Linear Regression With Changepoints
    Cui, Xiaolong
    Geng, Haoyu
    Wang, Zhaojun
    Zou, Changliang
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (10) : 7297 - 7319