How many classifiers do I need?

Abstract

Combining multiple classifiers promises to increase performance and robustness of a classification task. Currently, the understanding which combination scheme should be used and the ability to quantify the expected benefit is inadequate. This paper attempts to quantify the performance and robustness gain for different combination schemes and for two classifier types. The results indicate that the combination of a small number of classifiers may already result in a substantial performance gain. Also, the increase in robustness can be substantial by combining an adequate number of classifiers.