REGULARIZATION VIA DEEP GENERATIVE MODELS: AN ANALYSIS POINT OF VIEW

被引:4
|
作者
Oberlin, Thomas [1 ]
Verm, Mathieu [1 ]
机构
[1] Univ Toulouse, ISAE SUPAERO, 10 Ave Edouard Belin, F-31400 Toulouse, France
关键词
inverse problems; regularization; generative models; deep regularization; data-driven priors;
D O I
10.1109/ICIP42928.2021.9506138
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [21] Generalizing predictions to unseen sequencing profiles via deep generative models
    Oh, Min
    Zhang, Liqing
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [22] Aggregation and regularization schemes: a probabilistic point of view
    Torii, A. J.
    de Faria, J. R.
    Novotny, A. A.
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2022, 65 (03)
  • [23] Aggregation and regularization schemes: a probabilistic point of view
    A. J. Torii
    J. R. de Faria
    A. A. Novotny
    Structural and Multidisciplinary Optimization, 2022, 65
  • [24] Deep generative models in DataSHIELD
    Stefan Lenz
    Moritz Hess
    Harald Binder
    BMC Medical Research Methodology, 21
  • [25] Learning Deep Generative Models
    Salakhutdinov, Ruslan
    ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, VOL 2, 2015, 2 : 361 - 385
  • [26] Metrics for Deep Generative Models
    Chen, Nutan
    Klushyn, Alexej
    Kurle, Richard
    Jiang, Xueyan
    Bayer, Justin
    van der Smagt, Patrick
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [27] Asymmetric deep generative models
    Partaourides, Harris
    Chatzis, Sotirios P.
    NEUROCOMPUTING, 2017, 241 : 90 - 96
  • [28] Auxiliary Deep Generative Models
    Maaloe, Lars
    Sonderby, Casper Kaae
    Sonderby, Soren Kaae
    Winther, Ole
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [29] Deep Generative Models: Survey
    Oussidi, Achraf
    Elhassouny, Azeddine
    2018 INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV2018), 2018,
  • [30] Deep generative models in DataSHIELD
    Lenz, Stefan
    Hess, Moritz
    Binder, Harald
    BMC MEDICAL RESEARCH METHODOLOGY, 2021, 21 (01)