The forward-backward envelope for sampling with the overdamped Langevin algorithm

被引:3
|
作者
Eftekhari, Armin [1 ]
Vargas, Luis [2 ,3 ]
Zygalakis, Konstantinos C. [2 ,3 ]
机构
[1] Umea Univ, Dept Math & Math Stat, Umea, Sweden
[2] Bayes Ctr, Maxwell Inst Math Sci, 47 Potterrow, Edinburgh, Scotland
[3] Univ Edinburgh, Sch Math, Edinburgh, Scotland
基金
英国工程与自然科学研究理事会;
关键词
Markov chain Monte Carlo; Convex optimization; Langevin equation; MONTE-CARLO; MINIMIZATION; CONVERGENCE; SMOOTH;
D O I
10.1007/s11222-023-10254-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the Euler-Maruyama discretization of the Langevin equation, where the forward-backward envelope is used to deal with the non-smooth part of the dynamics. An advantage of this envelope, when compared to widely-used Moreu-Yoshida one and the MYULA algorithm, is that it maintains the MAP estimator of the original non-smooth distribution. We also study a number of numerical experiments that support our theoretical findings.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] A forward-backward single-source shortest paths algorithm
    Wilson, David B.
    Zwick, Uri
    2013 IEEE 54TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2013, : 707 - 716
  • [42] A GREEDY FORWARD-BACKWARD ALGORITHM FOR ATOMIC NORM CONSTRAINED MINIMIZATION
    Rao, Nikhil
    Shah, Parikshit
    Wright, Stephen
    Nowak, Robert
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 5885 - 5889
  • [43] Regularization in Tomographic Reconstruction Using Proximal Forward-Backward Algorithm
    Wang Li-yan
    Wei Zhi-hui
    2009 3RD INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICAL ENGINEERING, VOLS 1-11, 2009, : 2311 - +
  • [44] Adaptive Forward-Backward Greedy Algorithm for Learning Sparse Representations
    Zhang, Tong
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (07) : 4689 - 4708
  • [45] An inertially constructed forward-backward splitting algorithm in Hilbert spaces
    Arfat, Yasir
    Kumam, Poom
    Khan, Muhammad Aqeel Ahmad
    Ngiamsunthorn, Parinya Sa
    Kaewkhao, Attapol
    ADVANCES IN DIFFERENCE EQUATIONS, 2021, 2021 (01)
  • [46] KERNEL LMS ALGORITHM WITH FORWARD-BACKWARD SPLITTING FOR DICTIONARY LEARNING
    Gao, Wei
    Chen, Jie
    Richard, Cedric
    Huang, Jianguo
    Flamary, Remi
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 5735 - 5739
  • [47] Forward-backward semiclassical dynamics
    Wright, NJ
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2005, 230 : U1360 - U1360
  • [48] Forward-backward SDEs with reflections
    不详
    FORWARD-BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS AND THEIR APPLICATIONS, 1999, 1702 : 169 - 192
  • [49] A Generalized Forward-Backward Splitting
    Raguet, Hugo
    Fadili, Jalal
    Peyre, Gabriel
    SIAM JOURNAL ON IMAGING SCIENCES, 2013, 6 (03): : 1199 - 1226
  • [50] On unitary and forward-backward MODE
    Gershman, AB
    Stoica, P
    DIGITAL SIGNAL PROCESSING, 1999, 9 (02) : 67 - 75