Scalable Plug-and-Play ADMM With Convergence Guarantees

被引:57
|
作者
Sun, Yu [1 ]
Wu, Zihui [2 ]
Xu, Xiaojian [1 ]
Wohlberg, Brendt [3 ]
Kamilov, Ulugbek [1 ,4 ]
机构
[1] Washington Univ St Louis, Dept Comp Sci & Engn, St Louis, MO 63130 USA
[2] CALTECH, Dept Comp Sci, Pasadena, CA 91125 USA
[3] Los Alamos Natl Labora, Div Theoret, Los Alamos, NM 87545 USA
[4] Washington Univ, Dept Elect & Syst Engn, St Louis, MO 63130 USA
基金
美国国家科学基金会;
关键词
Convergence; Neural networks; Optimization; Scalability; Computer science; Approximation error; AWGN; Regularized image reconstruction; plug-and-play priors; deep learning; regularization parameter; INVERSE PROBLEMS; THRESHOLDING ALGORITHM; NEURAL-NETWORKS; IMAGE; RECONSTRUCTION; REGULARIZATION; RECOVERY; PRIORS; POINT;
D O I
10.1109/TCI.2021.3094062
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Plug-and-play priors (PnP) is a broadly applicable methodology for solving inverse problems by exploiting statistical priors specified as denoisers. Recent work has reported the state-of-the-art performance of PnP algorithms using pre-trained deep neural nets as denoisers in a number of imaging applications. However, current PnP algorithms are impractical in large-scale settings due to their heavy computational and memory requirements. This work addresses this issue by proposing an incremental variant of the widely used PnP-ADMM algorithm, making it scalable to problems involving a large number measurements. We theoretically analyze the convergence of the algorithm under a set of explicit assumptions, extending recent theoretical results in the area. Additionally, we show the effectiveness of our algorithm with nonsmooth data-fidelity terms and deep neural net priors, its fast convergence compared to existing PnP algorithms, and its scalability in terms of speed and memory.
引用
收藏
页码:849 / 863
页数:15
相关论文
共 50 条
  • [31] Plug-and-play features
    Plath, M
    Ryan, M
    FEATURE INTERACTIONS IN TELECOMMUNICATIONS AND SOFTWARE SYSTEMS V, 1998, : 150 - 164
  • [32] Plug-and-play with RNA
    Isaacs, FJ
    Collins, JJ
    NATURE BIOTECHNOLOGY, 2005, 23 (03) : 306 - 307
  • [33] Plug-and-play transport
    Hotch, R
    COMMUNICATIONS NEWS, 1998, 35 (01): : 12 - 13
  • [34] PLUG-AND-PLAY SATELLITES
    Lyke, James C.
    IEEE SPECTRUM, 2012, 49 (08) : 36 - 42
  • [35] Plug-and-play robots
    Gibbs, WW
    SCIENTIFIC AMERICAN, 2004, 290 (04) : 100 - +
  • [37] Plug-and-play intranet
    PC World (San Francisco, CA), 1998, 16 (06):
  • [38] Plug-and-play is on the way
    Automot Ind, 8 (41):
  • [39] Plug-and-play metrology
    Jennings, S
    PHOTONICS SPECTRA, 2004, 38 (08) : 81 - 82
  • [40] Plug-and-Play ADMM Based Radar Range Profile Reconstruction Using Deep Priors
    Akçapınar K.
    Önhon N.Ö.
    Gürbüz Ö.
    Çetin M.
    Progress In Electromagnetics Research C, 2024, 142 : 183 - 193