Robust group non-convex estimations for high-dimensional partially linear models

被引:16
|
作者
Wang, Mingqiu [1 ]
Tian, Guo-Liang [2 ]
机构
[1] Qufu Normal Univ, Sch Stat, Qufu 273165, Shandong, Peoples R China
[2] Univ Hong Kong, Dept Stat & Actuarial Sci, Pokfulam Rd, Hong Kong, Hong Kong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
robust group selection; high-dimensional data; non-convex penalty; partially linear models; 62G35; 62F12; 62F35; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; REGRESSION PARAMETERS; LASSO; ASYMPTOTICS; SHRINKAGE;
D O I
10.1080/10485252.2015.1112009
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
High-dimensional data with a group structure of variables arise always in many contemporary statistical modelling problems. Heavy-tailed errors or outliers in the response often exist in these data. We consider robust group selection for partially linear models when the number of covariates can be larger than the sample size. The non-convex penalty function is applied to achieve both goals of variable selection and estimation in the linear part simultaneously, and we use polynomial splines to estimate the nonparametric component. Under regular conditions, we show that the robust estimator enjoys the oracle property. Simulation studies demonstrate the performance of the proposed method with samples of moderate size. The analysis of a real example illustrates that our method works well.
引用
收藏
页码:49 / 67
页数:19
相关论文
共 50 条
  • [31] Robust and consistent variable selection in high-dimensional generalized linear models
    Avella-Medina, Marco
    Ronchetti, Elvezio
    BIOMETRIKA, 2018, 105 (01) : 31 - 44
  • [32] Scaling Simultaneous Optimistic Optimization for High-Dimensional Non-Convex Functions with Low Effective Dimensions
    Qian, Hong
    Yu, Yang
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 2000 - 2006
  • [33] Efficient adaptive estimation strategies in high-dimensional partially linear regression models
    Gao, Xiaoli
    Ahmed, S. Ejaz
    PERSPECTIVES ON BIG DATA ANALYSIS: METHODOLOGIES AND APPLICATIONS, 2014, 622 : 61 - 80
  • [34] Confidence intervals for high-dimensional partially linear single-index models
    Gueuning, Thomas
    Claeskens, Gerda
    JOURNAL OF MULTIVARIATE ANALYSIS, 2016, 149 : 13 - 29
  • [35] Double machine learning for partially linear mediation models with high-dimensional confounders
    Yang, Jichen
    Shao, Yujing
    Liu, Jin
    Wang, Lei
    NEUROCOMPUTING, 2025, 614
  • [36] On the oracle property of adaptive group Lasso in high-dimensional linear models
    Zhang, Caiya
    Xiang, Yanbiao
    STATISTICAL PAPERS, 2016, 57 (01) : 249 - 265
  • [37] On the oracle property of adaptive group Lasso in high-dimensional linear models
    Caiya Zhang
    Yanbiao Xiang
    Statistical Papers, 2016, 57 : 249 - 265
  • [38] Boosting for high-dimensional linear models
    Buhlmann, Peter
    ANNALS OF STATISTICS, 2006, 34 (02): : 559 - 583
  • [39] Robust Methods for High-Dimensional Linear Learning
    Merad, Ibrahim
    Gaiffas, Stephane
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [40] Analytical Study of Momentum-Based Acceleration Methods in Paradigmatic High-Dimensional Non-Convex Problems
    Mannelli, Stefano Sarao
    Urbani, Pierfrancesco
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34