EFFICIENT ERROR AND VARIANCE ESTIMATION FOR RANDOMIZED MATRIX COMPUTATIONS

被引:0
|
作者
Epperly, Ethan n. [1 ]
Tropp, Joel a. [1 ]
机构
[1] CALTECH, Dept Comp & Math Sci, Pasadena, CA 91125 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2024年 / 46卷 / 01期
关键词
jackknife resampling; low-rank approximation; error estimation; randomized algorithms;
D O I
10.1137/23M1558537
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the output. To meet this need, this paper proposes two diagnostics: a leave -one -out error estimator for randomized low -rank approximations and a jackknife resampling method to estimate the variance of the output of a randomized matrix computation. Both of these diagnostics are rapid to compute for randomized low -rank approximation algorithms such as the randomized SVD and randomized Nystro"\m approximation, and they provide useful information that can be used to assess the quality of the computed output and guide algorithmic parameter choices.
引用
收藏
页码:A508 / A528
页数:21
相关论文
共 50 条
  • [21] Variance estimation in the error components regression model
    Knapp, G
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2002, 31 (09) : 1499 - 1514
  • [22] Estimation of error variance via ridge regression
    Liu, X.
    Zheng, S.
    Feng, X.
    BIOMETRIKA, 2020, 107 (02) : 481 - 488
  • [23] A STUDY OF ERROR VARIANCE ESTIMATION IN LASSO REGRESSION
    Reid, Stephen
    Tibshirani, Robert
    Friedman, Jerome
    STATISTICA SINICA, 2016, 26 (01) : 35 - 67
  • [24] Error estimation and mesh refinement for computations of localisation in geomaterials
    Hicks, MA
    LOCALIZATION AND BIFURCATION THEORY FOR SOILS AND ROCKS, 1998, : 271 - 280
  • [25] The background of error estimation and adaptivity in finite element computations
    Zienkiewicz, OC
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2006, 195 (4-6) : 207 - 213
  • [26] Measurement error models and variance estimation in the presence of rounding error effects
    Burr, T.
    Hamada, M. S.
    Cremers, T.
    Weaver, B. P.
    Howell, J.
    Croft, S.
    Vardeman, S. B.
    ACCREDITATION AND QUALITY ASSURANCE, 2011, 16 (07) : 347 - 359
  • [27] Measurement error models and variance estimation in the presence of rounding error effects
    T. Burr
    M. S. Hamada
    T. Cremers
    B. P. Weaver
    J. Howell
    S. Croft
    S. B. Vardeman
    Accreditation and Quality Assurance, 2011, 16 : 347 - 359
  • [28] Estimation of genetic connectedness diagnostics based on prediction errors without the prediction error variance–covariance matrix
    John B. Holmes
    Ken G. Dodds
    Michael A. Lee
    Genetics Selection Evolution, 49
  • [29] Error analysis using the variance-covariance matrix
    Salter, C
    JOURNAL OF CHEMICAL EDUCATION, 2000, 77 (09) : 1239 - 1243
  • [30] ESTIMATION OF TRUE SCORE VARIANCE AND ERROR VARIANCE IN CLASSICAL TEST THEORY MODEL
    JACKSON, PH
    PSYCHOMETRIKA, 1973, 38 (02) : 183 - 201