SPECTRAL TENSOR-TRAIN DECOMPOSITION

被引:76
|
作者
Bigoni, Daniele [1 ,2 ]
Engsig-Karup, Allan P. [1 ]
Marzouk, Youssef M. [2 ]
机构
[1] Tech Univ Denmark, DK-2800 Lyngby, Denmark
[2] MIT, Dept Aeronaut & Astronaut, Cambridge, MA 02139 USA
来源
SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2016年 / 38卷 / 04期
关键词
approximation theory; tensor-train decomposition; orthogonal polynomials; uncertainty quantification; LOW-RANK APPROXIMATION; POLYNOMIAL INTERPOLATION; DIFFERENTIAL-EQUATIONS; QUADRATURE; MATRIX;
D O I
10.1137/15M1036919
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The accurate approximation of high-dimensional functions is an essential task in uncertainty quantification and many other fields. We propose a new function approximation scheme based on a spectral extension of the tensor-train (TT) decomposition. We first define a functional version of the TT decomposition and analyze its properties. We obtain results on the convergence of the decomposition, revealing links between the regularity of the function, the dimension of the input space, and the TT ranks. We also show that the regularity of the target function is preserved by the univariate functions (i.e., the "cores") comprising the functional TT decomposition. This result motivates an approximation scheme employing polynomial approximations of the cores. For functions with appropriate regularity, the resulting spectral tensor-train decomposition combines the favorable dimension-scaling of the TT decomposition with the spectral convergence rate of polynomial approximations, yielding efficient and accurate surrogates for high-dimensional functions. To construct these decompositions, we use the sampling algorithm TT-DMRG-cross to obtain the TT decomposition of tensors resulting from suitable discretizations of the target function. We assess the performance of the method on a range of numerical examples: a modified set of Genz functions with dimension up to 100, and functions with mixed Fourier modes or with local features. We observe significant improvements in performance over an anisotropic adaptive Smolyak approach. The method is also used to approximate the solution of an elliptic PDE with random input data.
引用
收藏
页码:A2405 / A2439
页数:35
相关论文
共 50 条
  • [41] Convolutional Auto-Encoder with Tensor-Train Factorization
    Sharma, Manish
    Markopoulos, Panos P.
    Saber, Eli
    Asif, M. Salman
    Prater-Bennette, Ashley
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 198 - 206
  • [42] Tensor-Train Numerical Integration of Multivariate Functions with Singularities
    Vysotsky, L., I
    Smirnov, A., V
    Tyrtyshnikov, E. E.
    LOBACHEVSKII JOURNAL OF MATHEMATICS, 2021, 42 (07) : 1608 - 1621
  • [43] A novel recursive least-squares adaptive method for streaming tensor-train decomposition with incomplete observations
    Trung, Le Thanh
    Abed-Meraim, Karim
    Trung, Nguyen Linh
    Hafiane, Adel
    SIGNAL PROCESSING, 2024, 216
  • [44] Performance Analysis for Tensor-Train Decomposition to Deep Neural Network Based Vector-to-Vector Regression
    Qi, Jun
    Ma, Xiaoli
    Lee, Chin-Hui
    Du, Jun
    Siniscalchi, Sabato Marco
    2020 54TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2020, : 7 - 12
  • [45] SIMPLE DEEP LEARNING NETWORK VIA TENSOR-TRAIN HAAR-WAVELET DECOMPOSITION WITHOUT RETRAINING
    Huang, Wei-Zhi
    Hsieh, Sung-Hsien
    Lu, Chun-Shien
    Pei, Soo-Chang
    2018 IEEE 28TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2018,
  • [46] High-Performance Tensor-Train Primitives Using GPU Tensor Cores
    Liu, Xiao-Yang
    Hong, Hao
    Zhang, Zeliang
    Tong, Weiqin
    Kossaifi, Jean
    Wang, Xiaodong
    Walid, Anwar
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (11) : 2634 - 2648
  • [47] Multi-Branch Tensor Network Structure for Tensor-Train Discriminant Analysis
    Sofuoglu, Seyyid Emre
    Aviyente, Selin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8926 - 8938
  • [48] TendiffPure: a convolutional tensor-train denoising diffusion model for purification
    Bai, Mingyuan
    Zhou, Derun
    Zhao, Qibin
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2024, 25 (01) : 160 - 169
  • [49] Expanding the Range of Hierarchical Equations of Motion by Tensor-Train Implementation
    Borrelli, Raffaele
    Dolgov, Sergey
    JOURNAL OF PHYSICAL CHEMISTRY B, 2021, 125 (20): : 5397 - 5407
  • [50] Nearest-neighbor interaction systems in the tensor-train format
    Gelss, Patrick
    Klus, Stefan
    Matera, Sebastian
    Schuette, Christof
    JOURNAL OF COMPUTATIONAL PHYSICS, 2017, 341 : 140 - 162