Breaking the curse of dimensionality in nonparametric testing

被引:45
|
作者
Lavergne, Pascal [1 ]
Patilea, Valentin [1 ]
机构
[1] Simon Fraser Univ, Dept Econ, Burnaby, BC V5A 1S6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
curse of dimensionality; testing; nonparametric methods;
D O I
10.1016/j.jeconom.2007.08.014
中图分类号
F [经济];
学科分类号
02 ;
摘要
For tests based on nonparametric methods, power crucially depends on the dimension of the conditioning variables, and specifically decreases with this dimension. This is known as the "curse of dimensionality". We propose a new general approach to nonparametric testing in high dimensional settings and we show how to implement it when testing for a parametric regression. The resulting test behaves against directional local alternatives almost as if the dimension of the regressors was one. It is also almost optimal against classes of one-dimensional alternatives for a suitable choice of the smoothing parameter. The test performs well in small samples compared to several other tests. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:103 / 122
页数:20
相关论文
共 50 条
  • [1] Breaking the curse of dimensionality
    Weimar, Markus
    DISSERTATIONES MATHEMATICAE, 2015, (505) : 5 - 112
  • [3] Breaking the Curse of Dimensionality with Convex Neural Networks
    Bach, Francis
    JOURNAL OF MACHINE LEARNING RESEARCH, 2017, 18
  • [4] Curse of dimensionality and related issues in nonparametric functional regression
    Geenens, Gery
    STATISTICS SURVEYS, 2011, 5 : 30 - 43
  • [5] ON DEEP LEARNING AS A REMEDY FOR THE CURSE OF DIMENSIONALITY IN NONPARAMETRIC REGRESSION
    Bauer, Benedikt
    Kohler, Michael
    ANNALS OF STATISTICS, 2019, 47 (04): : 2261 - 2285
  • [6] Breaking the curse of dimensionality for machine learning on genomic data
    O'Brien, A.
    Szul, P.
    Dunne, R.
    Bauer, D. C.
    EUROPEAN JOURNAL OF HUMAN GENETICS, 2018, 26 : 727 - 728
  • [7] Breaking the dimensionality curse in multi-server queues
    Brandwajn, Alexandre
    Begin, Thomas
    COMPUTERS & OPERATIONS RESEARCH, 2016, 73 : 141 - 149
  • [8] Breaking the Curse of Dimensionality Using Decompositions of Incomplete Tensors
    Vervliet, Nico
    Debals, Otto
    Sorber, Laurent
    De lathauwer, Lieven
    IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (05) : 71 - 79
  • [9] Adaptive Reduction of Curse of Dimensionality in Nonparametric Instrumental Variable Estimation
    Huang, Ming-Yueh
    Chan, Kwun Chuen Gary
    MATHEMATICS, 2025, 13 (01)
  • [10] Nonparametric Regression with Comparisons: Escaping the Curse of Dimensionality with Ordinal Information
    Xu, Yichong
    Muthakana, Hariank
    Balakrishnan, Sivaraman
    Dubrawski, Artur
    Singh, Aarti
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80