Optimal Rates for Regularization of Statistical Inverse Learning Problems

被引:71
|
作者
Blanchard, Gilles [1 ]
Muecke, Nicole [1 ]
机构
[1] Univ Potsdam, Inst Math, Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
关键词
Reproducing kernel Hilbert space; Spectral regularization; Inverse problem; Statistical learning; Minimax convergence rates; APPROXIMATION; ALGORITHMS; REGRESSION; OPERATORS;
D O I
10.1007/s10208-017-9359-7
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider a statistical inverse learning (also called inverse regression) problem, where we observe the image of a function f through a linear operator A at i.i.d. random design points X-i , superposed with an additive noise. The distribution of the design points is unknown and can be very general. We analyze simultaneously the direct (estimation of Af) and the inverse (estimation of f) learning problems. In this general framework, we obtain strong and weak minimax optimal rates of convergence (as the number of observations n grows large) for a large class of spectral regularization methods over regularity classes defined through appropriate source conditions. This improves on or completes previous results obtained in related settings. The optimality of the obtained rates is shown not only in the exponent in n but also in the explicit dependency of the constant factor in the variance of the noise and the radius of the source condition set.
引用
收藏
页码:971 / 1013
页数:43
相关论文
共 50 条
  • [21] Optimal Adaptation for Early Stopping in Statistical Inverse Problems
    Blanchard, Gilles
    Hoffmann, Marc
    Reiss, Markus
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2018, 6 (03): : 1043 - 1075
  • [22] Regularization, Bayesian Inference, and Machine Learning Methods for Inverse Problems
    Mohammad-Djafari, Ali
    ENTROPY, 2021, 23 (12)
  • [23] Learning the optimal Tikhonov regularizer for inverse problems
    Alberti, Giovanni S.
    De Vito, Ernesto
    Lassas, Matti
    Ratti, Luca
    Santacesaria, Matteo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [24] Convergence analysis of Tikhonov regularization for non-linear statistical inverse problems
    Rastogi, Abhishake
    Blanchard, Gilles
    Mathe, Peter
    ELECTRONIC JOURNAL OF STATISTICS, 2020, 14 (02): : 2798 - 2841
  • [25] Inverse problems for regularization matrices
    Silvia Noschese
    Lothar Reichel
    Numerical Algorithms, 2012, 60 : 531 - 544
  • [26] Kolmogorov complexity, statistical regularization of inverse problems, and Birkhoff's formalization of beauty
    Kreinovich, V
    Longpré, L
    Koshelev, M
    BAYESIAN INFERENCE FOR INVERSE PROBLEMS, 1998, 3459 : 159 - 170
  • [27] Inverse problems for regularization matrices
    Noschese, Silvia
    Reichel, Lothar
    NUMERICAL ALGORITHMS, 2012, 60 (04) : 531 - 544
  • [28] REGULARIZATION AND INVERSE PROBLEMS IN VISCOELASTICITY
    HEDSTROM, GW
    THIGPEN, L
    BONNER, BP
    WORLEY, PH
    JOURNAL OF APPLIED MECHANICS-TRANSACTIONS OF THE ASME, 1984, 51 (01): : 121 - 124
  • [29] Shape-constrained regularization by statistical multiresolution for inverse problems: asymptotic analysis
    Frick, Klaus
    Marnitz, Philipp
    Munk, Axel
    INVERSE PROBLEMS, 2012, 28 (06)
  • [30] Higher order convergence rates for Bregman iterated variational regularization of inverse problems
    Sprung, Benjamin
    Hohage, Thorsten
    NUMERISCHE MATHEMATIK, 2019, 141 (01) : 215 - 252