Boosting and instability for regression trees

The AdaBoost like algorithm for boosting CART regression trees is considered. The boosting predictors sequence is analysed on various data sets and the behaviour of the algorithm is investigated. An instability index of a given estimation method with respect to some training sample is defined. Based on the bagging algorithm, this instability index is then extended to quantify the additional instability provided by the boosting process with respect to the bagging one. Finally, the ability of boosting to track outliers and to concentrate on hard observations is used to explore a non-standard regression context. (c) 2004 Elsevier B.V. All rights reserved.