Model-free conditional screening via conditional distance correlation

被引:19
|
作者
Lu, Jun [1 ]
Lin, Lu [1 ,2 ]
机构
[1] Shandong Univ, Zhongtai Secur Inst Financial Studies, Jinan 250100, Peoples R China
[2] Qufu Normal Univ, Sch Stat, Qufu 273165, Shandong, Peoples R China
关键词
Ultrahigh dimensionality; Model free; Conditional distance correlation; Sure screening; VARIABLE SELECTION; LIKELIHOOD; REGRESSION; LASSO;
D O I
10.1007/s00362-017-0931-7
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
With the knowledge on the predetermined active predictors, we develop a feature screening procedure via the conditional distance correlation learning. The proposed procedure can significantly lower the correlation among the predictors when they are highly correlated and thus reduce the numbers of false positive and false negative. Meanwhile, when the conditional set is unable to be accessed beforehand, a data-driven method is provided to select it. We establish both the ranking consistency and the sure screening property for the new proposed procedure. To compare the performance of our method with its competitors, extensive simulations are conducted, which shows that the new procedure performs well in both the linear and nonlinear models. Finally, a real data analysis is investigated to further illustrate the effectiveness of the new method.
引用
收藏
页码:225 / 244
页数:20
相关论文
共 50 条
  • [41] Model-free data screening and cleaning
    Tarter, Michael E.
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2011, 3 (02): : 168 - 176
  • [42] CONDITIONAL AND PARTIAL CORRELATION
    LAWRANCE, AJ
    AMERICAN STATISTICIAN, 1976, 30 (03): : 146 - 149
  • [43] Modeling Multivariate Autoregressive Conditional Heteroskedasticity with the Double Smooth Transition Conditional Correlation GARCH Model
    Silvennoinen, Annastiina
    Terasvirta, Timo
    JOURNAL OF FINANCIAL ECONOMETRICS, 2009, 7 (04) : 373 - 411
  • [44] Structural Conditional Correlation
    Weber, Enzo
    JOURNAL OF FINANCIAL ECONOMETRICS, 2010, 8 (03) : 392 - 407
  • [45] Spatiotemporal Fusion via Conditional Diffusion Model
    Ma, Yaobin
    Wang, Qi
    Wei, Jingbo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [46] The conditional distance autocovariance function
    Zhang, Qiang
    Pan, Wenliang
    Li, Chengwei
    Wang, Xueqin
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2021, 49 (04): : 1093 - 1114
  • [47] Information distance and conditional complexities
    Vyugin, MV
    THEORETICAL COMPUTER SCIENCE, 2002, 271 (1-2) : 145 - 150
  • [48] Conditional-quantile screening for ultrahigh-dimensional survival data via martingale difference correlation
    Kai Xu
    Xudong Huang
    Science China Mathematics, 2018, 61 : 1907 - 1922
  • [49] Conditional-quantile screening for ultrahigh-dimensional survival data via martingale difference correlation
    Xu, Kai
    Huang, Xudong
    SCIENCE CHINA-MATHEMATICS, 2018, 61 (10) : 1907 - 1922
  • [50] Clustered dynamic conditional correlation multivariate GARCH model
    Zhou, Tu
    Chan, Laiwan
    DATA WAREHOUSING AND KNOWLEDGE DISCOVERY, PROCEEDINGS, 2008, 5182 : 206 - 216