CosmoVAE: Variational Autoencoder for CMB Image Inpainting

被引:0
|
作者
Yi, Kai [1 ]
Guo, Yi [1 ]
Fan, Yanan [1 ]
Hamann, Jan [2 ]
Wang, Yu Guang [1 ]
机构
[1] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
[2] Univ New South Wales, Sch Phys, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
variational autoencoder; cosmic microwave background; inpainting; deep learning; convolutional neural networks; uncertainty quantification; KL-divergence regularization; perceptual loss; total variation; angular power spectrum; VGG-16; ImageNet; COMPONENT SEPARATION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cosmic microwave background radiation (CMB) is critical to the understanding of the early universe and precise estimation of cosmological constants. Due to the contamination of thermal dust noise in the galaxy, the CMB map that is an image on the two-dimensional sphere has missing observations, mainly concentrated on the equatorial region. The noise of the CMB map has a significant impact on the estimation precision for cosmological parameters. Inpainting the CMB map can effectively reduce the uncertainty of parametric estimation. In this paper, we propose a deep learning-based variational autoencoder CosmoVAE, to restoring the missing observations of the CMB map. The input and output of CosmoVAE are square images. To generate training, validation, and test data sets, we segment the full-sky CMB map into many small images by Cartesian projection. CosmoVAE assigns physical quantities to the parameters of the VAE network by using Fourier coefficients, which are sampled by the angular power spectrum of the Gaussian random field as latent variables. CosmoVAE adopts a new loss function to improve the learning performance of the model, which consists of Li reconstruction loss, Kullback-Leibler divergence between the posterior distribution of encoder network and the prior distribution of latent variables, perceptual loss, and total-variation regularizer. The proposed model achieves state of the art performance for Planck Commander 2018 CMB map inpainting.
引用
收藏
页数:7
相关论文
共 50 条
  • [31] TransCNN-HAE: Transformer-CNN Hybrid AutoEncoder for Blind Image Inpainting
    Zhao, Haoru
    Gu, Zhaorui
    Zheng, Bing
    Zheng, Haiyong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6813 - 6821
  • [32] Low-l CMB analysis and inpainting
    Starck, J. -L.
    Fadili, M. J.
    Rassat, A.
    ASTRONOMY & ASTROPHYSICS, 2013, 550
  • [33] A topic modeling and image classification framework: The Generalized Dirichlet variational autoencoder
    Ojo, Akinlolu Oluwabusayo
    Bouguila, Nizar
    PATTERN RECOGNITION, 2024, 146
  • [34] Inference-Reconstruction Variational Autoencoder for Light Field Image Reconstruction
    Han, Kang
    Xiang, Wei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 5629 - 5644
  • [35] Remote sensing image captioning via Variational Autoencoder and Reinforcement Learning
    Shen, Xiangqing
    Liu, Bing
    Zhou, Yong
    Zhao, Jiaqi
    Liu, Mingming
    KNOWLEDGE-BASED SYSTEMS, 2020, 203
  • [36] Variational image inpainting models based on p-harmonic energy functional
    Zhang, Hongying
    Peng, Qicong
    Wu, Yadong
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 68 - 73
  • [37] Image forgery detection by combining Visual Transformer with Variational Autoencoder Network
    Atak, Ilker Galip
    Yasar, Ali
    APPLIED SOFT COMPUTING, 2024, 165
  • [38] AVAFN-adaptive variational autoencoder fusion network for multispectral image
    Chu, Wen-Lin
    Tu, Ching-Che
    Jian, Bo-Lin
    Multimedia Tools and Applications, 2024, 83 (41) : 89297 - 89315
  • [39] A variational approach to medical image inpainting based on mumford-shah model
    Feng, Zhilin
    Chi, Shuiming
    Yin, Jianwei
    Zhao, Duanyang
    Liu, Xiaoming
    2007 INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT, VOLS 1-3, 2007, : 536 - +
  • [40] Variational image inpainting technique based on nonlinear second-order diffusions
    Barbu, Tudor
    COMPUTERS & ELECTRICAL ENGINEERING, 2016, 54 : 345 - 353