Optimal Rates for Regularization of Statistical Inverse Learning Problems

被引:71
|
作者
Blanchard, Gilles [1 ]
Muecke, Nicole [1 ]
机构
[1] Univ Potsdam, Inst Math, Karl Liebknecht Str 24-25, D-14476 Potsdam, Germany
关键词
Reproducing kernel Hilbert space; Spectral regularization; Inverse problem; Statistical learning; Minimax convergence rates; APPROXIMATION; ALGORITHMS; REGRESSION; OPERATORS;
D O I
10.1007/s10208-017-9359-7
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider a statistical inverse learning (also called inverse regression) problem, where we observe the image of a function f through a linear operator A at i.i.d. random design points X-i , superposed with an additive noise. The distribution of the design points is unknown and can be very general. We analyze simultaneously the direct (estimation of Af) and the inverse (estimation of f) learning problems. In this general framework, we obtain strong and weak minimax optimal rates of convergence (as the number of observations n grows large) for a large class of spectral regularization methods over regularity classes defined through appropriate source conditions. This improves on or completes previous results obtained in related settings. The optimality of the obtained rates is shown not only in the exponent in n but also in the explicit dependency of the constant factor in the variance of the noise and the radius of the source condition set.
引用
收藏
页码:971 / 1013
页数:43
相关论文
共 50 条
  • [31] Higher order convergence rates for Bregman iterated variational regularization of inverse problems
    Benjamin Sprung
    Thorsten Hohage
    Numerische Mathematik, 2019, 141 : 215 - 252
  • [32] Optimal discretization of inverse problems in Hilbert scales.: Regularization and self-regularization of projection methods
    Mathé, P
    Pereverzev, SV
    SIAM JOURNAL ON NUMERICAL ANALYSIS, 2001, 38 (06) : 1999 - 2021
  • [33] From inverse problems to learning: a Statistical Mechanics approach
    Baldassi, Carlo
    Gerace, Federica
    Saglietti, Luca
    Zecchina, Riccardo
    COMPUTER SIMULATIONS IN PHYSICS AND BEYOND (CSP2017), 2018, 955
  • [34] Statistical Learning and Inverse Problems: A Stochastic Gradient Approach
    Fonseca, Yuri R.
    Saporito, Yuri F.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [35] REGULARIZATION OF INVERSE PROBLEMS: DEEP EQUILIBRIUM MODELS VERSUS BILEVEL LEARNING
    Riccio, Danilo
    Ehrhardt, Matthias j.
    Benning, Martin
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2023,
  • [36] Learning regularization parameters of inverse problems via deep neural networks
    Afkham, Babak Maboudi
    Chung, Julianne
    Chung, Matthias
    INVERSE PROBLEMS, 2021, 37 (10)
  • [37] On the acceleration of optimal regularization algorithms for linear ill-posed inverse problems
    Zhang, Ye
    CALCOLO, 2023, 60 (01)
  • [38] Sparse Regularization Based on Orthogonal Tensor Dictionary Learning for Inverse Problems
    Gemechu D.
    Mathematical Problems in Engineering, 2024, 2024
  • [39] A Generalized Conditional Gradient Method for Dynamic Inverse Problems with Optimal Transport Regularization
    Bredies, Kristian
    Carioni, Marcello
    Fanzon, Silvio
    Romero, Francisco
    FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2023, 23 (03) : 833 - 898
  • [40] Deep Equilibrium Learning of Explicit Regularization Functionals for Imaging Inverse Problems
    Zou, Zihao
    Liu, Jiaming
    Wohlberg, Brendt
    Kamilov, Ulugbek S.
    IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2023, 4 : 390 - 398