MULTIVARIATE REGRESSION AND MACHINE LEARNING WITH SUMS OF SEPARABLE FUNCTIONS

被引：70

作者：

Beylkin, Gregory ^{[1
]}

Garcke, Jochen ^{[2
]}

Mohlenkamp, Martin J. ^{[3
]}

机构：

[1] Univ Colorado, Dept Appl Math, Boulder, CO 80309 USA

[2] Tech Univ Berlin, Inst Math, D-10623 Berlin, Germany

[3] Ohio Univ, Dept Math, Athens, OH 45701 USA

来源：

SIAM JOURNAL ON SCIENTIFIC COMPUTING | 2009年 / 31卷 / 03期

关键词：

multivariate regression; machine learning; curse of dimensionality; separation of variables; SPARSE GRIDS; APPROXIMATION; ALGORITHMS; DIMENSIONS;

D O I：

10.1137/070710524

中图分类号：

O29 [应用数学];

学科分类号：

070104 ;

摘要：

We present an algorithm for learning (or estimating) a function of many variables from scattered data. The function is approximated by a sum of separable functions, following the paradigm of separated representations. The central fitting algorithm is linear in both the number of data points and the number of variables and, thus, is suitable for large data sets in high dimensions. We present numerical evidence for the utility of these representations. In particular, we show that our method outperforms other methods on several benchmark data sets.

引用

页码：1840 / 1857

页数：18

共 50 条

[21] Fuzzy regression functions with a noise cluster and the impact of outliers on mainstream machine learning methods in the regression setting
Chakravarty, Srinivas
Demirhan, Haydar
Baser, Furkan
Demirhan, Haydar (haydar.demirhan@rmit.edu.au), 1600, Elsevier Ltd (96):
[22] Fuzzy regression functions with a noise cluster and the impact of outliers on mainstream machine learning methods in the regression setting
Chakravarty, Srinivas
Demirhan, Haydar
Baser, Furkan
APPLIED SOFT COMPUTING, 2020, 96
[23] Machine Learning Scoring Functions Based on Random Forest and Support Vector Regression
Ballester, Pedro J.
PATTERN RECOGNITION IN BIOINFORMATICS, 2012, 7632 : 14 - 25
[24] Sums of Separable and Quadratic Polynomials
Ahmadi, Amir Ali
Dibek, Cemil
Hall, Georgina
MATHEMATICS OF OPERATIONS RESEARCH, 2023, 48 (03) : 1316 - 1343
[25] Data Confidentiality in Machine Learning: Exploring Multivariate Regression and Its Application on Encrypted Medical Data
Affum E.
Enchill M.
SN Computer Science, 5 (4)
[26] Efficiency and Core Loss Map Estimation with Machine Learning Based Multivariate Polynomial Regression Model
Misir, Oguz
Akar, Mehmet
MATHEMATICS, 2022, 10 (19)
[27] Multivariate analysis of fMRI time series: classification and regression of brain responses using machine learning
Formisano, Elia
De Martino, Federico
Valente, Giancarlo
MAGNETIC RESONANCE IMAGING, 2008, 26 (07) : 921 - 934
[28] Learning to rank by using multivariate adaptive regression splines and conic multivariate adaptive regression splines
Altinok, Gulsah
Karagoz, Pinar
Batmaz, Inci
COMPUTATIONAL INTELLIGENCE, 2021, 37 (01) : 371 - 408
[29] Approximation, characterization, and continuity of multivariate monotonic regression functions
Schmid, Jochen
ANALYSIS AND APPLICATIONS, 2022, 20 (04) : 737 - 775
[30] THE HEBB RULE FOR LEARNING LINEARLY SEPARABLE BOOLEAN FUNCTIONS - LEARNING AND GENERALIZATION
VALLET, F
EUROPHYSICS LETTERS, 1989, 8 (08): : 747 - 751

← 1 2 3 4 5 →