Feature Selection via Concave Minimization and Support Vector Machines

Computational comparison is made between two feature selection approaches for nding a separating plane that discriminates between two point sets in an n-dimensional feature space that utilizes as few of the n features (dimensions) as possible. In the concave minimization approach 19, 5] a separating plane is generated by minimizing a weighted sum of distances of misclassi ed points to two parallel planes that bound the sets and which determine the separating plane midway between them. Furthermore, the number of dimensions of the space used to determine the plane is minimized. In the support vector machine approach 27, 7, 1, 10, 24, 28], in addition to minimizing the weighted sum of distances of misclassi ed points to the bounding planes, we also maximize the distance between the two bounding planes that generate the separating plane. Computational results show that feature suppression is an indirect consequence of the support vector machine approach when an appropriate norm is used. N...

• Type: Conference
• Year: 1998
• Where: ICML
• Authors: Paul S. Bradley, Olvi L. Mangasarian
• Keywords: Concave Minimization Approach, ICML 1998, Machine Learning, Separating Plane, Support Vector Machine