Bias-corrected random forests in regression

被引:144
|
作者
Zhang, Guoyi [1 ]
Lu, Yan [1 ]
机构
[1] Univ New Mexico, Dept Math & Stat, Albuquerque, NM 87131 USA
关键词
bias correction; mean-squared prediction error; random forests; regression; simulation;
D O I
10.1080/02664763.2011.578621
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
It is well known that random forests reduce the variance of the regression predictors compared to a single tree, while leaving the bias unchanged. In many situations, the dominating component in the risk turns out to be the squared bias, which leads to the necessity of bias correction. In this paper, random forests are used to estimate the regression function. Five different methods for estimating bias are proposed and discussed. Simulated and real data are used to study the performance of these methods. Our proposed methods are significantly effective in reducing bias in regression context.
引用
收藏
页码:151 / 160
页数:10
相关论文
共 50 条
  • [1] BIAS-CORRECTED QUANTILE REGRESSION FORESTS FOR HIGH-DIMENSIONAL DATA
    Nguyen Thanh Tung
    Huang, Joshua Zhexue
    Thuy Thi Nguyen
    Khan, Imran
    PROCEEDINGS OF 2014 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL 1, 2014, : 1 - 6
  • [2] Bias-corrected confidence bands in nonparametric regression
    Xia, YC
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1998, 60 : 797 - 811
  • [3] Bias-corrected quantile regression estimation of censored regression models
    Cizek, P.
    Sadikoglu, S.
    STATISTICAL PAPERS, 2018, 59 (01) : 215 - 247
  • [4] Bias-corrected quantile regression estimation of censored regression models
    P. Čížek
    S. Sadikoglu
    Statistical Papers, 2018, 59 : 215 - 247
  • [5] Stable and bias-corrected estimation for nonparametric regression models
    Lin, Lu
    Li, Feng
    JOURNAL OF NONPARAMETRIC STATISTICS, 2008, 20 (04) : 283 - 303
  • [6] Bias-Corrected AIC for Selecting Variables in Poisson Regression Models
    Kamo, Ken-Ichi
    Yanagihara, Hirokazu
    Satoh, Kenichi
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2013, 42 (11) : 1911 - 1921
  • [7] Bias-Corrected Bootstrap Inference for Regression Models with Autocorrelated Errors
    Kim, Jae
    ECONOMICS BULLETIN, 2005, 3
  • [8] Bias-corrected estimation for GI0 regression with applications
    Sousa, M. F. S. S.
    Vasconcelos, J. M.
    Nascimento, A. D. C.
    ASTA-ADVANCES IN STATISTICAL ANALYSIS, 2025,
  • [9] Jackknife Bias-Corrected Generalized Regression Estimator in Survey Sampling
    Stefan, Marius
    Hidiroglou, Michael A.
    JOURNAL OF SURVEY STATISTICS AND METHODOLOGY, 2024, 12 (01) : 211 - 231
  • [10] Bias-corrected AIC for selecting variables in multinomial logistic regression models
    Yanagihara, Hirokazu
    Kamo, Ken-ichi
    Imori, Shinpei
    Satoh, Kenichi
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2012, 436 (11) : 4329 - 4341