Riemannian Score-Based Generative Modelling

被引:0
|
作者
De Bortoli, Valentin [1 ]
Mathieu, Emile [2 ]
Hutchinson, Michael [2 ]
Thornton, James [2 ]
Teh, Yee Whye [2 ]
Doucet, Arnaud [2 ]
机构
[1] PSL Univ Paris, CNRS, ENS, Dept Comp Sci, Paris, France
[2] Univ Oxford, Dept Stat, Oxford, England
基金
英国工程与自然科学研究理事会;
关键词
LAPLACIAN; KERNEL; INEQUALITIES; CONVERGENCE; EIGENVALUE; MANIFOLDS; MAPS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Score-based generative models (SGMs) are a powerful class of generative models that exhibit remarkable empirical performance. Score-based generative modelling (SGM) consists of a "noising" stage, whereby a diffusion is used to gradually add Gaussian noise to data, and a generative model, which entails a "denoising" process defined by approximating the time-reversal of the diffusion. Existing SGMs assume that data is supported on a Euclidean space, i.e. a manifold with flat geometry. In many domains such as robotics, geoscience or protein modelling, data is often naturally described by distributions living on Riemannian manifolds and current SGM techniques are not appropriate. We introduce here Riemannian Score-based Generative Models (RSGMs), a class of generative models extending SGMs to Riemannian manifolds. We demonstrate our approach on a variety of manifolds, and in particular with earth and climate science spherical data.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Score-based Generative Models with Levy Processes
    Yoon, Eunbi
    Park, Keehun
    Kim, Sungwoong
    Lim, Sungbin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] Score-based Generative Modeling in Latent Space
    Vahdat, Arash
    Kreis, Karsten
    Kautz, Jan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] Adversarial Purification with Score-based Generative Models
    Yoon, Jongmin
    Hwang, Sung Ju
    Lee, Juho
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [4] Score-Based Generative Models Detect Manifolds
    Pidstrigach, Jakiw
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] On Investigating the Conservative Property of Score-Based Generative Models
    Chao, Chen-Hao
    Sun, Wei-Fang
    Cheng, Bo-Wun
    Lee, Chun-Yi
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202
  • [6] Improved Techniques for Training Score-Based Generative Models
    Song, Yang
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [7] Score-Based Generative Models for Robust Channel Estimation
    Arvinte, Marius
    Tamir, Jonathan, I
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 453 - 458
  • [8] Score-based generative models for calorimeter shower simulation
    Mikuni, Vinicius
    Nachman, Benjamin
    PHYSICAL REVIEW D, 2022, 106 (09)
  • [9] Convergence for score-based generative modeling with polynomial complexity
    Lee, Holden
    Lu, Jianfeng
    Tan, Yixin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [10] Unifying GANs and Score-Based Diffusion as Generative Particle Models
    Franceschi, Jean-Yves
    Gartrell, Mike
    Dos Santos, Ludovic
    Issenhuth, Thibaut
    de Bezenac, Emmanuel
    Chen, Mickael
    Rakotomamonjy, Alain
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,