CosmoVAE: Variational Autoencoder for CMB Image Inpainting

被引:0
|
作者
Yi, Kai [1 ]
Guo, Yi [1 ]
Fan, Yanan [1 ]
Hamann, Jan [2 ]
Wang, Yu Guang [1 ]
机构
[1] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
[2] Univ New South Wales, Sch Phys, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
variational autoencoder; cosmic microwave background; inpainting; deep learning; convolutional neural networks; uncertainty quantification; KL-divergence regularization; perceptual loss; total variation; angular power spectrum; VGG-16; ImageNet; COMPONENT SEPARATION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cosmic microwave background radiation (CMB) is critical to the understanding of the early universe and precise estimation of cosmological constants. Due to the contamination of thermal dust noise in the galaxy, the CMB map that is an image on the two-dimensional sphere has missing observations, mainly concentrated on the equatorial region. The noise of the CMB map has a significant impact on the estimation precision for cosmological parameters. Inpainting the CMB map can effectively reduce the uncertainty of parametric estimation. In this paper, we propose a deep learning-based variational autoencoder CosmoVAE, to restoring the missing observations of the CMB map. The input and output of CosmoVAE are square images. To generate training, validation, and test data sets, we segment the full-sky CMB map into many small images by Cartesian projection. CosmoVAE assigns physical quantities to the parameters of the VAE network by using Fourier coefficients, which are sampled by the angular power spectrum of the Gaussian random field as latent variables. CosmoVAE adopts a new loss function to improve the learning performance of the model, which consists of Li reconstruction loss, Kullback-Leibler divergence between the posterior distribution of encoder network and the prior distribution of latent variables, perceptual loss, and total-variation regularizer. The proposed model achieves state of the art performance for Planck Commander 2018 CMB map inpainting.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] Variational Models for Color Image Inpainting and Their Split Bregman Algorithms
    Jisheng Zhou Zhenkuan Pan Weibo Wei Guohao Liang
    科技信息, 2011, (06) : 153 - 156
  • [22] ANALYSIS OF A VARIATIONAL FRAMEWORK FOR EXEMPLAR-BASED IMAGE INPAINTING
    Arias, P.
    Caselles, V.
    Facciolo, G.
    MULTISCALE MODELING & SIMULATION, 2012, 10 (02): : 473 - 514
  • [23] A Class of Fractional-Order Variational Image Inpainting Models
    Zhang, Y.
    Pu, Y-F
    Hu, J-R
    Zhou, J-L
    APPLIED MATHEMATICS & INFORMATION SCIENCES, 2012, 6 (02): : 299 - 306
  • [24] Semantic image inpainting with dense and dilated deep convolutional autoencoder adversarial network
    Ren, Kun
    Fan, Chunqi
    Meng, Lisha
    Huang, Long
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [25] Image inpainting via variational approximation of a Dirichlet problem with free discontinuity
    Carriero, Michele
    Leaci, Antonio
    Tomarelli, Franco
    ADVANCES IN CALCULUS OF VARIATIONS, 2014, 7 (03) : 267 - 295
  • [26] Synthetic Aperture Radar Image Compression Based on a Variational Autoencoder
    Xu, Qihan
    Xiang, Yunfan
    Di, Zhixiong
    Fan, Yibo
    Feng, Quanyuan
    Wu, Qiang
    Shi, Jiangyi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [27] FusionVAE: A Deep Hierarchical Variational Autoencoder for RGB Image Fusion
    Duffhauss, Fabian
    Ngo Anh Vien
    Ziesche, Hanna
    Neumann, Gerhard
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 674 - 691
  • [28] Image Augmentation based on Variational Autoencoder for Breast Tumor Segmentation
    Balaji, K.
    ACADEMIC RADIOLOGY, 2023, 30 : S172 - S183
  • [29] Variational AutoEncoder for Reference based Image Super-Resolution
    Liu, Zhi-Song
    Siu, Wan-Chi
    Wang, Li-Wen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 516 - 525
  • [30] A Robust Image Watermarking Approach Using Cycle Variational Autoencoder
    Wei, Qiang
    Wang, Hu
    Zhang, Gongxuan
    SECURITY AND COMMUNICATION NETWORKS, 2020, 2020