Dimensionality Reduction for Classification

We investigate the effects of dimensionality reduction using different techniques and different dimensions on six two-class data sets with numerical attributes as pre-processing for two classification algorithms. Besides reducing the dimensionality with the use of principal components and linear discriminants, we also introduce four new techniques. After this dimensionality reduction two algorithms are applied. The first algorithm takes advantage of the reduced dimensionality itself while the second one directly exploits the dimensional ranking. We observe that neither a single superior dimensionality reduction technique nor a straightforward way to select the optimal dimension can be identified. On the other hand we show that a good choice of technique and dimension can have a major impact on the classification power, generating classifiers that can rival industry standards. We conclude that dimensionality reduction should not only be used for visualisation or as pre-processing on ver...

• Type: Conference
• Year: 2008
• Where: ADMA
• Authors: Frank Plastria, Steven De Bruyne, Emilio Carrizosa
• Keywords: ADMA 2008, Data Mining, Dimensionality Reduction, Dimensionality Reduction Technique, Superior Dimensionality Reduction