Boosting margin based distance functions for clustering

The performance of graph based clustering methods critically depends on the quality of the distance function, used to compute similarities between pairs of neighboring nodes. In this paper we learn distance functions by training binary classifiers with margins. The classifiers are defined over the product space of pairs of points and are trained to distinguish whether two points come from the same class or not. The signed margin is used as the distance value. Our main contribution is a distance learning method (DistBoost), which combines boosting hypotheses over the product space with a weak learner based on partitioning the original feature space. Each weak hypothesis is a Gaussian mixture model computed using a semi-supervised constrained EM algorithm, which is trained using both unlabeled and labeled data. We also consider SVM and decision trees boosting as margin based classifiers in the product space. We experimentally compare the margin based distance functions with other existi...

• Type: Conference
• Year: 2004
• Where: ICML
• Authors: Tomer Hertz, Aharon Bar-Hillel, Daphna Weinshall
• Keywords: Distance Learning Method, ICML 2004, Machine Learning, Margin Based Classifiers, Margin Based Distance