REGULARIZATION VIA DEEP GENERATIVE MODELS: AN ANALYSIS POINT OF VIEW

被引:4
|
作者
Oberlin, Thomas [1 ]
Verm, Mathieu [1 ]
机构
[1] Univ Toulouse, ISAE SUPAERO, 10 Ave Edouard Belin, F-31400 Toulouse, France
关键词
inverse problems; regularization; generative models; deep regularization; data-driven priors;
D O I
10.1109/ICIP42928.2021.9506138
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [31] Denoising Deep Generative Models
    Loaiza-Ganem, Gabriel
    Ross, Brendan Leigh
    Wu, Luhuan
    Cunningham, John P.
    Cresswell, Jesse C.
    Caterini, Anthony L.
    PROCEEDINGS ON I CAN'T BELIEVE IT'S NOT BETTER! - UNDERSTANDING DEEP LEARNING THROUGH EMPIRICAL FALSIFICATION, VOL 187, 2022, 187 : 41 - 50
  • [32] An Overview of Deep Generative Models
    Xu, Jungang
    Li, Hui
    Zhou, Shilong
    IETE TECHNICAL REVIEW, 2015, 32 (02) : 131 - 139
  • [33] Multi-task Regularization of Generative Similarity Models
    Cazzanti, Luca
    Feldman, Sergey
    Gupta, Maya R.
    Gabbay, Michael
    SIMILARITY-BASED PATTERN RECOGNITION: FIRST INTERNATIONAL WORKSHOP, SIMBAD 2011, 2011, 7005 : 90 - 103
  • [34] Multi-task Regularization of Generative Similarity Models
    Cazzanti, Luca
    Feldman, Sergey
    Gupta, Maya R.
    Gabbay, Michael
    SIMILARITY-BASED PATTERN RECOGNITION, 2011, 7005 : 90 - +
  • [35] French prepositions from a generative point of view
    Mensching, G
    ZEITSCHRIFT FUR FRANZOSISCHE SPRACHE UND LITERATUR, 2004, 114 (02): : 184 - 188
  • [36] A Generative Model with Ensemble Manifold Regularization for Multi-view Clustering
    Wang, Shaokai
    Ye, Yunming
    Lau, Raymond Y. K.
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, ICIC 2015, PT III, 2015, 9227 : 109 - 114
  • [37] Deep Generative Multi-view Learning
    Karami, Mahdi
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT I, 2020, 1167 : 465 - 477
  • [38] Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Models
    Ritchie, Daniel
    Wang, Kai
    Lin, Yu-an
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 6175 - 6183
  • [39] Accelerated antimicrobial discovery via deep generative models and molecular dynamics simulations
    Payel Das
    Tom Sercu
    Kahini Wadhawan
    Inkit Padhi
    Sebastian Gehrmann
    Flaviu Cipcigan
    Vijil Chenthamarakshan
    Hendrik Strobelt
    Cicero dos Santos
    Pin-Yu Chen
    Yi Yan Yang
    Jeremy P. K. Tan
    James Hedrick
    Jason Crain
    Aleksandra Mojsilovic
    Nature Biomedical Engineering, 2021, 5 : 613 - 623
  • [40] Accelerated antimicrobial discovery via deep generative models and molecular dynamics simulations
    Das, Payel
    Sercu, Tom
    Wadhawan, Kahini
    Padhi, Inkit
    Gehrmann, Sebastian
    Cipcigan, Flaviu
    Chenthamarakshan, Vijil
    Strobelt, Hendrik
    dos Santos, Cicero
    Chen, Pin-Yu
    Yang, Yi Yan
    Tan, Jeremy P. K.
    Hedrick, James
    Crain, Jason
    Mojsilovic, Aleksandra
    NATURE BIOMEDICAL ENGINEERING, 2021, 5 (06) : 613 - +