Sparse estimation in high-dimensional linear errors-in-variables regression via a covariate relaxation method

被引:0
|
作者
Li, Xin [1 ]
Wu, Dongya [2 ]
机构
[1] Northwest Univ, Sch Math, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
[2] Northwest Univ, Sch Informat Sci & Technol, Xuefu Rd, Xian 710069, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Sparse recovery; Errors-in-variables model; Covariate relaxation; Statistical consistency; MINIMAX RATES; SELECTION;
D O I
10.1007/s11222-023-10312-5
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Sparse signal recovery in high-dimensional settings via regularization techniques has been developed in the past two decades and produces fruitful results in various areas. Previous studies mainly focus on the idealized assumption where covariates are free of noise. However, in realistic scenarios, covariates are always corrupted by measurement errors, which may induce significant estimation bias when methods for clean data are naively applied. Recent studies begin to deal with the errors-in-variables models. Current method either depends on the distribution of covariate noise or does not depends on the distribution but is inconsistent in parameter estimation. A novel covariate relaxation method that does not depend on the distribution of covariate noise is proposed. Statistical consistency on parameter estimation is established. Numerical experiments are conducted and show that the covariate relaxation method achieves the same or even better estimation accuracy than that of the state of art nonconvex Lasso estimator. The advantage that the covariate relaxation method is independent of the distribution of covariate noise while produces a small estimation error suggests its prospect in practical applications.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] ESTIMATION OF OBSERVATION-ERROR VARIANCE IN ERRORS-IN-VARIABLES REGRESSION
    Delaigle, Aurore
    Hall, Peter
    STATISTICA SINICA, 2011, 21 (03) : 1023 - 1063
  • [42] Minimax Rates of lp-Losses for High-Dimensional Linear Errors-in-Variables Models over lq-Balls
    Li, Xin
    Wu, Dongya
    ENTROPY, 2021, 23 (06)
  • [43] High-dimensional linear regression via implicit regularization
    Zhao, Peng
    Yang, Yun
    He, Qiao-Chu
    BIOMETRIKA, 2022, 109 (04) : 1033 - 1046
  • [44] A Method of ARX Model Estimation of Errors-in-Variables Systems
    Liu, Xin
    Zhu, Yucai
    IFAC PAPERSONLINE, 2015, 48 (28): : 302 - 306
  • [45] Sparse High-Dimensional Isotonic Regression
    Gamarnik, David
    Gaudio, Julia
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [46] Error density estimation in high-dimensional sparse linear model
    Zou, Feng
    Cui, Hengjian
    ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2020, 72 (02) : 427 - 449
  • [47] Quantile regression estimates for a class of linear and partially linear errors-in-variables models
    He, XM
    Liang, H
    STATISTICA SINICA, 2000, 10 (01) : 129 - 140
  • [48] Error density estimation in high-dimensional sparse linear model
    Feng Zou
    Hengjian Cui
    Annals of the Institute of Statistical Mathematics, 2020, 72 : 427 - 449
  • [49] On parameter estimation for semi-linear errors-in-variables models
    Cui, HJ
    Li, RC
    JOURNAL OF MULTIVARIATE ANALYSIS, 1998, 64 (01) : 1 - 24
  • [50] Estimation and testing for partially functional linear errors-in-variables models
    Zhu, Hanbing
    Zhang, Riquan
    Yu, Zhou
    Lian, Heng
    Liu, Yanghui
    JOURNAL OF MULTIVARIATE ANALYSIS, 2019, 170 : 296 - 314