Covariance Kernels from Bayesian Generative Models

We propose the framework of mutual information kernels for learning covariance kernels, as used in Support Vector machines and Gaussian process classifiers, from unlabeled task data using Bayesian techniques. We describe an implementation of this framework which uses variational Bayesian mixtures of factor analyzers in order to attack classification problems in high-dimensional spaces where labeled data is sparse, but unlabeled data is abundant.

• Type: Conference
• Year: 2001
• Where: NIPS
• Authors: Matthias Seeger
• Keywords: Mutual Information Kernels, NIPS 2001, NIPS 2007, Unlabeled Task Data, Variational Bayesian Mixtures