Fast spatial Gaussian process maximum likelihood estimation via skeletonization factorizations

被引:6
|
作者
Minden V. [1 ]
Damle A. [2 ]
Ho K.L. [3 ]
Ying L. [1 ,4 ]
机构
[1] Institute for Computational and Mathematical Engineering, Stanford University, Stanford, 94305, CA
[2] Department of Computer Science, Cornell University, Ithaca, 14850, NY
[3] TSMC Technology Inc., San Jose, 95134, CA
[4] Department of Mathematics, Institute for Computational and Mathematical Engineering, Stanford University, Stanford, 94305, CA
来源
| 1600年 / Society for Industrial and Applied Mathematics Publications卷 / 15期
基金
美国国家科学基金会;
关键词
Fast algorithms; Hierarchical matrices; Kriging; Maximum likelihood estimation; Spatial Gaussian processes;
D O I
10.1137/17M1116477
中图分类号
学科分类号
摘要
Maximum likelihood estimation for parameter fitting given observations from a Gaussian process in space is a computationally demanding task that restricts the use of such methods to moderately sized datasets. We present a framework for unstructured observations in two spatial dimensions that allows for evaluation of the log-likelihood and its gradient (i.e., the score equations) in Õ(n3/2) time under certain assumptions, where n is the number of observations. Our method relies on the skeletonization procedure described by Martinsson and Rokhlin [J. Cornput. Phys., 205 (2005), pp. 1-23] in the form of the recursive skeletonization factorization of Ho and Ying [Cornrn. Pure Appl. Math., 69 (2015), pp. 1415-1451]. Combining this with an adaptation of the matrix peeling algorithm of Lin, Lu, and Ying [J. Cornput. Phys., 230 (2011), pp, 4071-4087] for constructing ℋ-matrix representations of black-box operators, we obtain a framework that can be used in the context of any first-order optimization routine to quickly and accurately compute maximum likelihood estimates. © 2017 Society for Industrial and Applied Mathematics.
引用
收藏
页码:1584 / 1611
页数:27
相关论文
共 50 条
  • [31] Maximum likelihood estimation for Gaussian processes under inequality constraints
    Bachoc, Francois
    Lagnoux, Agnes
    Lopez-Lopera, Andres F.
    ELECTRONIC JOURNAL OF STATISTICS, 2019, 13 (02): : 2921 - 2969
  • [32] Maximum likelihood estimation of noisy Gaussian Markov random fields
    Coli, M
    Ippoliti, L
    ITI 2002: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY INTERFACES, 2002, : 85 - 90
  • [33] A frequency domain algorithm for maximum likelihood estimation of Gaussian fields
    Butler, NA
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 1999, 64 (02) : 151 - 165
  • [34] Penalized maximum likelihood estimation for Gaussian hidden Markov models
    Alexandrovich, Grigory
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2016, 45 (20) : 6133 - 6148
  • [35] ON THE EXACT MAXIMUM-LIKELIHOOD ESTIMATION OF GAUSSIAN AUTOREGRESSIVE PROCESSES
    CERNUSCHIFRIAS, B
    ROGERS, JD
    IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1988, 36 (06): : 922 - 924
  • [36] Bayesian and Maximum Likelihood Estimation for Gaussian Processes on an Incomplete Lattice
    Stroud, Jonathan R.
    Stein, Michael L.
    Lysen, Shaun
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (01) : 108 - 120
  • [37] Maximum Likelihood Estimation for a Smooth Gaussian Random Field Model
    Xu, Wanting
    Stein, Michael L.
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2017, 5 (01): : 138 - 175
  • [38] Maximum likelihood estimation in linear models with a Gaussian model matrix
    Wiesel, A
    Eldar, YC
    Beck, A
    IEEE SIGNAL PROCESSING LETTERS, 2006, 13 (05) : 292 - 295
  • [39] A fast maximum likelihood estimation approach to LAD regression
    Li, YB
    Arce, GR
    2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL II, PROCEEDINGS: SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING SIGNAL PROCESSING THEORY AND METHODS, 2004, : 889 - 892
  • [40] Fast maximum likelihood estimation for general hierarchical models
    Hong, Johnny
    Stoudt, Sara
    de Valpine, Perry
    JOURNAL OF APPLIED STATISTICS, 2025, 52 (03) : 595 - 623