REGULARIZATION VIA DEEP GENERATIVE MODELS: AN ANALYSIS POINT OF VIEW

被引:4
|
作者
Oberlin, Thomas [1 ]
Verm, Mathieu [1 ]
机构
[1] Univ Toulouse, ISAE SUPAERO, 10 Ave Edouard Belin, F-31400 Toulouse, France
关键词
inverse problems; regularization; generative models; deep regularization; data-driven priors;
D O I
10.1109/ICIP42928.2021.9506138
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [11] Deep generative models of gravitational waveforms via conditional autoencoder
    Liao, Chung-Hao
    Lin, Feng-Li
    PHYSICAL REVIEW D, 2021, 103 (12)
  • [12] DISCRIMINANT ANALYSIS REGULARIZATION IN LIGHTWEIGHT DEEP CNN MODELS
    Tzelepi, Maria
    Tefas, Anastasios
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3841 - 3845
  • [13] Improving Regularization of Deep Learning Models in Fundus Analysis
    Hsu, Wei-Wen
    Chang, Yao-Chung
    Lee, Wei-Min
    Huang, Yu-Chuan
    Lu, Da-Wen
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 898 - 901
  • [14] Further Analysis of Outlier Detection with Deep Generative Models
    Wang, Ziyu
    Dai, Bin
    Wipf, David
    Zhu, Jun
    NEURIPS WORKSHOPS, 2020, 2020, 137 : 11 - 20
  • [15] DGPose: Deep Generative Models for Human Body Analysis
    Rodrigo de Bem
    Arnab Ghosh
    Thalaiyasingam Ajanthan
    Ondrej Miksik
    Adnane Boukhayma
    N. Siddharth
    Philip Torr
    International Journal of Computer Vision, 2020, 128 : 1537 - 1563
  • [16] DGPose: Deep Generative Models for Human Body Analysis
    de Bem, Rodrigo
    Ghosh, Arnab
    Ajanthan, Thalaiyasingam
    Miksik, Ondrej
    Boukhayma, Adnane
    Siddharth, N.
    Torr, Philip
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) : 1537 - 1563
  • [17] Diversity in Deep Generative Models and Generative AI
    Turinici, Gabriel
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, LOD 2023, PT II, 2024, 14506 : 84 - 93
  • [18] Generative clustering analysis with constraints regularization
    Yu, Yue-Cheng
    Sheng, Jia-Gen
    Zou, Xiao-Hua
    Yu, Y.-C. (yuyuecheng@nuaa.edu.cn), 1600, Chinese Institute of Electronics (36): : 777 - 783
  • [19] Generating real-world hypergraphs via deep generative models
    Zuo, Xianglin
    Chen, Wenqi
    Song, Xianduo
    Wang, Xin
    Wang, Ying
    INFORMATION SCIENCES, 2023, 647
  • [20] Generalizing predictions to unseen sequencing profiles via deep generative models
    Min Oh
    Liqing Zhang
    Scientific Reports, 12