Stacking with Multi-response Model Trees

We empirically evaluate several state-of-the-art methods for constructing ensembles of classifiers with stacking and show that they perform (at best) comparably to selecting the best classifier from the ensemble by cross validation. We then propose a new method for stacking, that uses multi-response model trees at the meta-level, and show that it outperforms existing stacking approaches, as well as selecting the best classifier from the ensemble by cross validation.

• Type: Journal
• Year: 2002
• Where: MCS
• Authors: Saso Dzeroski, Bernard Zenko
• Keywords: MCS 2002, Multi-response Model Trees, Outperforms Existing Stacking, Pattern Recognition, State-of-the-art Methods