MULTIVARIATE REGRESSION AND MACHINE LEARNING WITH SUMS OF SEPARABLE FUNCTIONS

被引：70

作者：

Beylkin, Gregory ^{[1
]}

Garcke, Jochen ^{[2
]}

Mohlenkamp, Martin J. ^{[3
]}

机构：

[1] Univ Colorado, Dept Appl Math, Boulder, CO 80309 USA

[2] Tech Univ Berlin, Inst Math, D-10623 Berlin, Germany

[3] Ohio Univ, Dept Math, Athens, OH 45701 USA

来源：

SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2009年 / 31卷 / 03期

关键词：

multivariate regression; machine learning; curse of dimensionality; separation of variables; SPARSE GRIDS; APPROXIMATION; ALGORITHMS; DIMENSIONS;

D O I：

10.1137/070710524

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We present an algorithm for learning (or estimating) a function of many variables from scattered data. The function is approximated by a sum of separable functions, following the paradigm of separated representations. The central fitting algorithm is linear in both the number of data points and the number of variables and, thus, is suitable for large data sets in high dimensions. We present numerical evidence for the utility of these representations. In particular, we show that our method outperforms other methods on several benchmark data sets.

引用

页码：1840 / 1857

页数：18

共 50 条

[31] Estimation of monthly evaporative loss using relevance vector machine, extreme learning machine and multivariate adaptive regression spline models
Ravinesh C. Deo
Pijush Samui
Dookie Kim
Stochastic Environmental Research and Risk Assessment, 2016, 30 : 1769 - 1784
[32] Estimation of monthly evaporative loss using relevance vector machine, extreme learning machine and multivariate adaptive regression spline models
Deo, Ravinesh C.
Samui, Pijush
Kim, Dookie
STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2016, 30 (06) : 1769 - 1784
[33] DEGREES OF SUMS IN A SEPARABLE FIELD EXTENSION
ISAACS, IM
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 1970, 25 (03) : 638 - &
[34] Detecting Valid Multivariate Linear Regression Using Moving Sums Processes of the Vectors of Observations
Somayasa, Wayan
Sutiari, Desak Ketut
PROCEEDINGS OF THE 8TH SEAMS-UGM INTERNATIONAL CONFERENCE ON MATHEMATICS AND ITS APPLICATIONS 2019: DEEPENING MATHEMATICAL CONCEPTS FOR WIDER APPLICATION THROUGH MULTIDISCIPLINARY RESEARCH AND INDUSTRIES COLLABORATIONS, 2019, 2192
[35] Active Machine Learning in Regression Problems
Lapsins, J.
Cakula, S.
2021 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEE IEEM21), 2021, : 1020 - 1023
[36] Machine Learning Predictions as Regression Covariates
Fong, Christian
Tyler, Matthew
POLITICAL ANALYSIS, 2021, 29 (04) : 467 - 484
[37] FITTING MULTIVARIATE REGRESSION-FUNCTIONS BY INTERACTION SPLINE MODELS
CHEN, ZH
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1993, 55 (02): : 473 - 491
[38] MEMO FUNCTIONS AND MACHINE LEARNING
MICHIE, D
NATURE, 1968, 218 (5138) : 306 - &
[39] ESTIMATING BOUNDED REGRESSION FUNCTIONS AND HYBRID MULTIVARIATE PROBIT APPLICATION
KAU, PK
AMERICAN JOURNAL OF AGRICULTURAL ECONOMICS, 1974, 56 (05) : 1201 - 1201
[40] Machine Learning, Functions and Goals
Butlin, Patrick
CROATIAN JOURNAL OF PHILOSOPHY, 2022, 22 (66) : 351 - 370

← 1 2 3 4 5 →