CosmoVAE: Variational Autoencoder for CMB Image Inpainting

被引:0
|
作者
Yi, Kai [1 ]
Guo, Yi [1 ]
Fan, Yanan [1 ]
Hamann, Jan [2 ]
Wang, Yu Guang [1 ]
机构
[1] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
[2] Univ New South Wales, Sch Phys, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
variational autoencoder; cosmic microwave background; inpainting; deep learning; convolutional neural networks; uncertainty quantification; KL-divergence regularization; perceptual loss; total variation; angular power spectrum; VGG-16; ImageNet; COMPONENT SEPARATION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cosmic microwave background radiation (CMB) is critical to the understanding of the early universe and precise estimation of cosmological constants. Due to the contamination of thermal dust noise in the galaxy, the CMB map that is an image on the two-dimensional sphere has missing observations, mainly concentrated on the equatorial region. The noise of the CMB map has a significant impact on the estimation precision for cosmological parameters. Inpainting the CMB map can effectively reduce the uncertainty of parametric estimation. In this paper, we propose a deep learning-based variational autoencoder CosmoVAE, to restoring the missing observations of the CMB map. The input and output of CosmoVAE are square images. To generate training, validation, and test data sets, we segment the full-sky CMB map into many small images by Cartesian projection. CosmoVAE assigns physical quantities to the parameters of the VAE network by using Fourier coefficients, which are sampled by the angular power spectrum of the Gaussian random field as latent variables. CosmoVAE adopts a new loss function to improve the learning performance of the model, which consists of Li reconstruction loss, Kullback-Leibler divergence between the posterior distribution of encoder network and the prior distribution of latent variables, perceptual loss, and total-variation regularizer. The proposed model achieves state of the art performance for Planck Commander 2018 CMB map inpainting.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Catch Missing Details: Image Reconstruction with Frequency Augmented Variational Autoencoder
    Lin, Xinmiao
    Li, Yikang
    Hsiao, Jenhao
    Ho, Chiuman
    Kong, Yu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1736 - 1745
  • [42] Learning an Optimisable Semantic Segmentation Map with Image Conditioned Variational Autoencoder
    Zhuang, Pengcheng
    Sekikawa, Yusuke
    Hara, Kosuke
    Saito, Hideo
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 : 379 - 389
  • [43] Semisupervised SAR image change detection based on a siamese variational autoencoder
    Zhao, Guangwei
    Peng, Yaxin
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (01)
  • [44] A novel binary quantizer for variational autoencoder-based image compressor
    Thulasidharan, Pillai Praveen
    Nath, Keshab
    International Journal of Computers and Applications, 2024, 46 (08) : 604 - 620
  • [45] PDE-based Image Restoration using Variational Denoising and Inpainting Models
    Barbu, Tudor
    Ciobanu, Adrian
    Luca, Mihaela
    2014 18TH INTERNATIONAL CONFERENCE SYSTEM THEORY, CONTROL AND COMPUTING (ICSTCC), 2014, : 688 - 691
  • [46] Dirichlet Variational Autoencoder
    Joo, Weonyoung
    Lee, Wonsung
    Park, Sungrae
    Moon, Il-Chul
    PATTERN RECOGNITION, 2020, 107
  • [47] The Autoencoding Variational Autoencoder
    Cemgil, A. Taylan
    Ghaisas, Sumedh
    Dvijotham, Krishnamurthy
    Gowal, Sven
    Kohli, Pushmeet
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [48] Grammar Variational Autoencoder
    Kusner, Matt J.
    Paige, Brooks
    Hernandez-Lobato, Jose Miguel
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [49] Matting through variational inpainting
    Ni, Kangyu
    Thiruvenkadam, Sheshadri
    Chan, Tony
    PROCEEDINGS OF THE NINTH IASTED INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, 2007, : 179 - 184
  • [50] Quantum variational autoencoder
    Khoshaman, Amir
    Vinci, Walter
    Denis, Brandon
    Andriyash, Evgeny
    Amin, Mohammad H.
    QUANTUM SCIENCE AND TECHNOLOGY, 2019, 4 (01)