The forward-backward envelope for sampling with the overdamped Langevin algorithm

被引:3
|
作者
Eftekhari, Armin [1 ]
Vargas, Luis [2 ,3 ]
Zygalakis, Konstantinos C. [2 ,3 ]
机构
[1] Umea Univ, Dept Math & Math Stat, Umea, Sweden
[2] Bayes Ctr, Maxwell Inst Math Sci, 47 Potterrow, Edinburgh, Scotland
[3] Univ Edinburgh, Sch Math, Edinburgh, Scotland
基金
英国工程与自然科学研究理事会;
关键词
Markov chain Monte Carlo; Convex optimization; Langevin equation; MONTE-CARLO; MINIMIZATION; CONVERGENCE; SMOOTH;
D O I
10.1007/s11222-023-10254-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the Euler-Maruyama discretization of the Langevin equation, where the forward-backward envelope is used to deal with the non-smooth part of the dynamics. An advantage of this envelope, when compared to widely-used Moreu-Yoshida one and the MYULA algorithm, is that it maintains the MAP estimator of the original non-smooth distribution. We also study a number of numerical experiments that support our theoretical findings.
引用
收藏
页数:24
相关论文
共 50 条
  • [31] A DOUBLE FORWARD-BACKWARD ALGORITHM USING LINESEARCHES FOR MINIMIZATION PROBLEMS
    Cholamjiak, Prasit
    Kankam, Kunrada
    Srinet, Phootares
    Pholasa, Nattawut
    THAI JOURNAL OF MATHEMATICS, 2020, 18 (01): : 63 - 76
  • [32] An Accelerated Forward-Backward Algorithm with Applications to Image Restoration Problems
    Janngam, Kobkoon
    Suantai, Suthep
    THAI JOURNAL OF MATHEMATICS, 2021, 19 (02): : 325 - 339
  • [33] New inertial forward-backward algorithm for convex minimization with applications
    Kankam, Kunrada
    Cholamjiak, Watcharaporn
    Cholamjiak, Prasit
    DEMONSTRATIO MATHEMATICA, 2023, 56 (01)
  • [34] A forward-backward stochastic algorithm for quasi-linear PDEs
    Delarue, F
    Menozzi, S
    ANNALS OF APPLIED PROBABILITY, 2006, 16 (01): : 140 - 184
  • [35] A DYNAMICAL APPROACH TO AN INERTIAL FORWARD-BACKWARD ALGORITHM FOR CONVEX MINIMIZATION
    Attouch, Hedy
    Peypouquet, Juan
    Redont, Patrick
    SIAM JOURNAL ON OPTIMIZATION, 2014, 24 (01) : 232 - 256
  • [36] INERTIAL VARIABLE METRIC TECHNIQUES FOR THE INEXACT FORWARD-BACKWARD ALGORITHM
    Bonettini, S.
    Rebegoldi, S.
    Ruggiero, V
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2018, 40 (05): : A3180 - A3210
  • [37] Joint Segmentation and Shape Regularization With a Generalized Forward-Backward Algorithm
    Stefanoiu, Anca
    Weinmann, Andreas
    Storath, Martin
    Navab, Nassir
    Baust, Maximilian
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (07) : 3384 - 3394
  • [38] VARIABLE METRIC FORWARD-BACKWARD ALGORITHM FOR COMPOSITE MINIMIZATION PROBLEMS
    Repetti, Audrey
    Wiaux, Yves
    SIAM JOURNAL ON OPTIMIZATION, 2021, 31 (02) : 1215 - 1241
  • [39] Approximate forward-backward algorithm for a switching linear Gaussian model
    Hammer, Hugo
    Tjelmeland, Hakon
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2011, 55 (01) : 154 - 167
  • [40] A forward-backward algorithm for decomposable semi-definite programs
    Fabiani, Filippo
    Grammatico, Sergio
    2020 28TH MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION (MED), 2020, : 580 - 585