Robust group non-convex estimations for high-dimensional partially linear models

被引:16
|
作者
Wang, Mingqiu [1 ]
Tian, Guo-Liang [2 ]
机构
[1] Qufu Normal Univ, Sch Stat, Qufu 273165, Shandong, Peoples R China
[2] Univ Hong Kong, Dept Stat & Actuarial Sci, Pokfulam Rd, Hong Kong, Hong Kong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
robust group selection; high-dimensional data; non-convex penalty; partially linear models; 62G35; 62F12; 62F35; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; REGRESSION PARAMETERS; LASSO; ASYMPTOTICS; SHRINKAGE;
D O I
10.1080/10485252.2015.1112009
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
High-dimensional data with a group structure of variables arise always in many contemporary statistical modelling problems. Heavy-tailed errors or outliers in the response often exist in these data. We consider robust group selection for partially linear models when the number of covariates can be larger than the sample size. The non-convex penalty function is applied to achieve both goals of variable selection and estimation in the linear part simultaneously, and we use polynomial splines to estimate the nonparametric component. Under regular conditions, we show that the robust estimator enjoys the oracle property. Simulation studies demonstrate the performance of the proposed method with samples of moderate size. The analysis of a real example illustrates that our method works well.
引用
收藏
页码:49 / 67
页数:19
相关论文
共 50 条
  • [21] Online stochastic gradient descent on non-convex losses from high-dimensional inference
    Ben Arous, Gerard
    Gheissari, Reza
    Jagannath, Aukosh
    JOURNAL OF MACHINE LEARNING RESEARCH, 2021, 22
  • [22] A new test for high-dimensional regression coefficients in partially linear models
    Zhao, Fanrong
    Lin, Nan
    Zhang, Baoxue
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2023, 51 (01): : 5 - 18
  • [23] Variable Selection in High-Dimensional Partially Linear Models with Longitudinal Data
    Yang Yiping
    Xue Liugen
    RECENT ADVANCE IN STATISTICS APPLICATION AND RELATED AREAS, VOLS I AND II, 2009, : 661 - 667
  • [24] Distributed debiased estimation of high-dimensional partially linear models with jumps
    Zhao, Yan-Yong
    Zhang, Yuchun
    Liu, Yuan
    Ismail, Noriszura
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2024, 191
  • [25] Online stochastic gradient descent on non-convex losses from high-dimensional inference
    Arous, Gerard Ben
    Gheissari, Reza
    Jagannath, Aukosh
    Journal of Machine Learning Research, 2021, 22
  • [26] SCAD-PENALIZED REGRESSION IN HIGH-DIMENSIONAL PARTIALLY LINEAR MODELS
    Xie, Huiliang
    Huang, Jian
    ANNALS OF STATISTICS, 2009, 37 (02): : 673 - 696
  • [27] Adaptive group Lasso for high-dimensional generalized linear models
    Wang, Mingqiu
    Tian, Guo-Liang
    STATISTICAL PAPERS, 2019, 60 (05) : 1469 - 1486
  • [28] Adaptive group Lasso for high-dimensional generalized linear models
    Mingqiu Wang
    Guo-Liang Tian
    Statistical Papers, 2019, 60 : 1469 - 1486
  • [29] Overlapping group lasso for high-dimensional generalized linear models
    Zhou, Shengbin
    Zhou, Jingke
    Zhang, Bo
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (19) : 4903 - 4917
  • [30] Robust Inference for High-Dimensional Linear Models via Residual Randomization
    Wang, Y. Samuel
    Lee, Si Kai
    Toulis, Panos
    Kolar, Mladen
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7818 - 7828