The Margin Perceptron with Unlearning

We introduce into the classical Perceptron algorithm with margin a mechanism of unlearning which in the course of the regular update allows for a reduction of possible contributions from "very well classified" patterns to the weight vector. The resulting incremental classification algorithm, called Margin Perceptron with Unlearning (MPU), provably converges in a finite number of updates to any desirable chosen before running approximation of either the maximal margin or the optimal 1-norm soft margin solution. Moreover, an experimental comparative evaluation involving representative linear Support Vector Machines reveals that the MPU algorithm is very competitive.

• Type: Journal
• Year: 2010
• Where: ICML
• Authors: Constantinos Panagiotakopoulos, Petroula Tsampouka
• Keywords: 1-norm Soft Margin, Classical Perceptron Algorithm, ICML 2010, Machine Learning, Margin Perceptron