On the Effectiveness of Diversity When Training Multiple Classifier Systems

Discussions about the trade-off between accuracy and diversity when designing Multiple Classifier Systems is all active topic in Machine Learning. One possible way of considering the design of Multiple Classifier Systems is to select the ensemble members from a large pool of classifiers focusing on predefined criteria, which is known as the Overproduce and Choose paradigm. In this paper, a genetic algorithm is proposed to design Multiple Classifier Systems under this paradigm while controlling the trade-off between accuracy and diversity of the ensemble members. The proposed algorithm is compared with several classifier selection methods from the literature on different UCI Repository datasets. This paper specifies several conditions for which it is worth using diversity during the design stage of Multiple Classifier Systems.