REGULARIZATION VIA DEEP GENERATIVE MODELS: AN ANALYSIS POINT OF VIEW

被引:4
|
作者
Oberlin, Thomas [1 ]
Verm, Mathieu [1 ]
机构
[1] Univ Toulouse, ISAE SUPAERO, 10 Ave Edouard Belin, F-31400 Toulouse, France
关键词
inverse problems; regularization; generative models; deep regularization; data-driven priors;
D O I
10.1109/ICIP42928.2021.9506138
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [41] Molecular generation targeting desired electronic properties via deep generative models
    Yuan, Qi
    Santana-Bonilla, Alejandro
    Zwijnenburg, Martijn A.
    Jelfs, Kim E.
    NANOSCALE, 2020, 12 (12) : 6744 - 6758
  • [42] Bridging Explicit and Implicit Deep Generative Models via Neural Stein Estimators
    Wu, Qitian
    Gao, Rui
    Zha, Hongyuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [43] A survey of regularization strategies for deep models
    Reza Moradi
    Reza Berangi
    Behrouz Minaei
    Artificial Intelligence Review, 2020, 53 : 3947 - 3986
  • [44] Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models
    Che, Tong
    Liu, Xiaofeng
    Li, Site
    Ge, Yubin
    Zhang, Ruixiang
    Xiong, Caiming
    Bengio, Yoshua
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7002 - 7010
  • [45] A survey of regularization strategies for deep models
    Moradi, Reza
    Berangi, Reza
    Minaei, Behrouz
    ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (06) : 3947 - 3986
  • [46] Analysis and synthesis of 3D shape families via deep-learned generative models of surfaces
    Huang, Haibin
    Kalogerakis, Evangelos
    Marlin, Benjamin
    COMPUTER GRAPHICS FORUM, 2015, 34 (05) : 25 - 38
  • [47] PREmbed: Balancing Conditional Generative Models with Embedding Pretraining and Regularization
    Liu, Haiyang
    Endo, Yuki
    Lee, Jinho
    Kamijo, Shunsuke
    ELECTRONICS, 2025, 14 (02):
  • [48] Deep generative models for peptide design
    Wan, Fangping
    Kontogiorgos-Heintz, Daphne
    de la Fuente-Nunez, Cesar
    DIGITAL DISCOVERY, 2022, 1 (03): : 195 - 208
  • [49] An Architecture for Deep, Hierarchical Generative Models
    Bachman, Philip
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [50] IMAGE RESTORATION WITH DEEP GENERATIVE MODELS
    Yeh, Raymond A.
    Lim, Teck Yian
    Chen, Chen
    Schwing, Alexander G.
    Hasegawa-Johnson, Mark
    Do, Minh N.
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 6772 - 6776