RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs

被引:39
|
作者
Fan, Yingying [1 ]
Demirkaya, Emre [2 ]
Li, Gaorong [3 ]
Lv, Jinchi [1 ]
机构
[1] Univ Southern Calif, Marshall Sch Business, Data Sci & Operat Dept, Los Angeles, CA 90089 USA
[2] Univ Tennessee, Dept Business Analyt & Stat, Haslam Coll Business, Knoxville, TN USA
[3] Beijing Univ Technol, Beijing Inst Sci & Engn Comp, Beijing, Peoples R China
关键词
Big data; Graphical nonlinear knockoffs; High-dimensional nonlinear models; Large-scale inference and FDR; Power; Reproducibility; Robustness; FALSE DISCOVERY RATE; VARIABLE SELECTION; UNKNOWN SPARSITY; REGRESSION; TESTS; IDENTIFICATION; BOOTSTRAP; RATES;
D O I
10.1080/01621459.2018.1546589
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this article, we provide theoretical foundations on the power and robustness for the model-X knockoffs procedure introduced recently in Candes, Fan, Janson and Lv in high-dimensional setting when the covariate distribution is characterized by Gaussian graphical model. We establish that under mild regularity conditions, the power of the oracle knockoffs procedure with known covariate distribution in high-dimensional linear models is asymptotically one as sample size goes to infinity. When moving away from the ideal case, we suggest the modified model-X knockoffs method called graphical nonlinear knockoffs (RANK) to accommodate the unknown covariate distribution. We provide theoretical justifications on the robustness of our modified procedure by showing that the false discovery rate (FDR) is asymptotically controlled at the target level and the power is asymptotically one with the estimated covariate distribution. To the best of our knowledge, this is the first formal theoretical result on the power for the knockoffs procedure. Simulation results demonstrate that compared to existing approaches, our method performs competitively in both FDR control and power. A real dataset is analyzed to further assess the performance of the suggested knockoffs procedure. for this article are available online.
引用
收藏
页码:362 / 379
页数:18
相关论文
共 50 条
  • [31] Variational Inference for Large-Scale Models of Discrete Choice
    Braun, Michael
    McAuliffe, Jon
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (489) : 324 - 335
  • [32] Causal relationship inference for a large-scale cellular network
    Zhou, Tong
    Wang, Ya-Li
    BIOINFORMATICS, 2010, 26 (16) : 2020 - 2028
  • [33] Large-scale inference of the transcriptional regulation of Bacillus subtilis
    Gupta, A
    Varner, JD
    Maranas, CD
    COMPUTERS & CHEMICAL ENGINEERING, 2005, 29 (03) : 565 - 576
  • [34] Inference for Large-Scale Linear Systems With Known Coefficients
    Fang, Zheng
    Santos, Andres
    Shaikh, Azeem M.
    Torgovitsky, Alexander
    ECONOMETRICA, 2023, 91 (01) : 299 - 327
  • [35] LinkedIn Skills: Large-Scale Topic Extraction and Inference
    Bastian, Mathieu
    Hayes, Matthew
    Vaughan, William
    Shah, Sam
    Skomoroch, Peter
    Kim, Hyungjin
    PROCEEDINGS OF THE 8TH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS'14), 2014, : 1 - 8
  • [36] Establishing local strong accessibility of large-scale nonlinear systems by replacing the Lie algebraic rank condition
    Van Willigenburg, L. Gerard
    Stigter, Johannes D.
    Molenaar, Jaap
    2021 EUROPEAN CONTROL CONFERENCE (ECC), 2021, : 2645 - 2650
  • [37] Message Passing Inference for Large Scale Graphical Models with High Order Potentials
    Zhang, Jian
    Schwing, Alexander G.
    Urtasun, Raquel
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [38] A numerical study on large-scale nonlinear solvers
    GomesRuggiero, MA
    Kozakevich, DN
    Martinez, JM
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 1996, 32 (03) : 1 - 13
  • [39] Numerical study on large-scale nonlinear solvers
    Univ of Campinas, Campinas, Brazil
    Comput Math Appl, 3 (1-13):
  • [40] Nonlinear destabilization of large-scale oceanic fronts
    Karsten, RH
    Swaters, GE
    11TH CONFERENCE ON ATMOSPHERIC AND OCEANIC FLUID DYNAMICS, 1997, : 147 - 151