Discriminative Gaussian Mixture Models: A Comparison with Kernel Classifiers

We show that a classifier based on Gaussian mixture models (GMM) can be trained discriminatively to improve accuracy. We describe a training procedure based on the extended Baum-Welch algorithm used in speech recognition. We also compare the accuracy and degree of sparsity of the new discriminative GMM classifier with those of generative GMM classifiers, and of kernel classifiers, such as support vector machines (SVM) and relevance vector machines (RVM).

• Type: Conference
• Year: 2003
• Where: ICML
• Authors: Aldebaro Klautau, Nikola Jevtic, Alon Orlitsky
• Keywords: Discriminative Gmm Classifier, Extended Baum-welch Algorithm, Generative Gmm Classifiers, ICML 2003, Machine Learning