The asymptotics of semi-supervised learning in discriminative probabilistic models

Semi-supervised learning aims at taking advantage of unlabeled data to improve the efficiency of supervised learning procedures. For discriminative models however, this is a challenging task. In this contribution, we introduce an original methodology for using unlabeled data through the design of a simple semi-supervised objective function. We prove that the corresponding semi-supervised estimator is asymptotically optimal. The practical consequences of this result are discussed for the case of the logistic regression model.

• Type: Conference
• Year: 2008
• Where: ICML
• Authors: François Yvon, Nataliya Sokolovska, Olivier Cappé
• Keywords: Corresponding Semi-supervised Estimator, ICML 2008, Machine Learning, Semi-supervised Learning, Semi-supervised Objective Function