EFFICIENT ERROR AND VARIANCE ESTIMATION FOR RANDOMIZED MATRIX COMPUTATIONS

被引:0
|
作者
Epperly, Ethan n. [1 ]
Tropp, Joel a. [1 ]
机构
[1] CALTECH, Dept Comp & Math Sci, Pasadena, CA 91125 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2024年 / 46卷 / 01期
关键词
jackknife resampling; low-rank approximation; error estimation; randomized algorithms;
D O I
10.1137/23M1558537
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the output. To meet this need, this paper proposes two diagnostics: a leave -one -out error estimator for randomized low -rank approximations and a jackknife resampling method to estimate the variance of the output of a randomized matrix computation. Both of these diagnostics are rapid to compute for randomized low -rank approximation algorithms such as the randomized SVD and randomized Nystro"\m approximation, and they provide useful information that can be used to assess the quality of the computed output and guide algorithmic parameter choices.
引用
收藏
页码:A508 / A528
页数:21
相关论文
共 50 条
  • [1] Variance matrix estimation in multivariate classical measurement error models
    Kekec, Elif
    Van Keilegom, Ingrid
    STATISTICAL PAPERS, 2024, 65 (03) : 1259 - 1284
  • [2] Estimation of the variance matrix in bivariate classical measurement error models
    Kekec, Elif
    Van Keilegom, Ingrid
    ELECTRONIC JOURNAL OF STATISTICS, 2022, 16 (01): : 1831 - 1854
  • [3] Efficient error variance estimation in non-parametric regression
    Li, Zhijian
    Lin, Wei
    AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2020, 62 (04) : 467 - 484
  • [4] A bootstrap method for error estimation in randomized matrix multiplication
    Lopes, Miles E.
    Wang, Shusen
    Mahoney, Michael W.
    Journal of Machine Learning Research, 2019, 20
  • [5] A Bootstrap Method for Error Estimation in Randomized Matrix Multiplication
    Lopes, Miles E.
    Wang, Shusen
    Mahoney, Michael W.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [6] Estimation error in mean returns and the mean-variance efficient frontier
    Simaan, Majeed
    Simaan, Yusif
    Tang, Yi
    INTERNATIONAL REVIEW OF ECONOMICS & FINANCE, 2018, 56 : 109 - 124
  • [7] ESTIMATION OF PREDICTION ERROR VARIANCE
    HANNAN, EJ
    NICHOLLS, DF
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1977, 72 (360) : 834 - 840
  • [8] Condition and Error Estimates in Numerical Matrix Computations
    Konstantinov, M. M.
    Petkov, P. H.
    APPLICATIONS OF MATHEMATICS IN ENGINEERING AND ECONOMICS '34, 2008, 1067 : 38 - +
  • [9] Advancing Matrix Computations with Randomized Preprocessing
    Pan, Victor Y.
    Qian, Guoliang
    Zheng, Ai-Long
    COMPUTER SCIENCE - THEORY AND APPLICATIONS, 2010, 6072 : 303 - +
  • [10] On the estimation of radar rainfall error variance
    Iowa Institute of Hydraulic Research, The University of Iowa, Iowa City, IA 52242, United States
    Adv. Water Resour., 6 (585-595):