A Competitive Learning Approach to Instance Selection for Support Vector Machines

Abstract. Support Vector Machines (SVM) have been applied successfully in a wide variety of fields in the last decade. The SVM problem is formulated as a convex objective function subject to box constraints that needs to be maximized, a quadratic programming (QP) problem. In order to solve the QP problem on larger data sets specialized algorithms and heuristics are required. In this paper we present a new data-squashing method for selecting training instances in support vector learning. Inspired by the growing neural gas algorithm and learning vector quantization we introduce a new, parameter robust neural gas variant to retrieve an initial approximation of the training set containing only those samples that will likely become support vectors in the final classifier. This first approximation is refined in the border areas, defined by neighboring neurons of different classes, yielding the final training set. We evaluate our approach on synthetic as well as real-life datasets, co...

• Type: Conference
• Year: 2009
• Where: KSEM
• Authors: Mario Zechner, Michael Granitzer
• Keywords: Data Sets, KSEM 2009, Support Vector, Support Vector Machine, Theoretical Computer Science