Discriminative structure selection method of Gaussian Mixture Models with its application to handwritten digit recognition

, Yunde Jia Model structure selection is currently an open problem in modeling data via Gaussian Mixture Models (GMM). This paper proposes a discriminative method to select GMM structures for pattern classification. We introduce a GMM structure selection criterion based on a discriminative objective function called Soft target based Max-Min posterior Pseudo-probabilities (Soft-MMP). The structure and the parameters of the optimal GMM are estimated simultaneously by seeking the maximum value of Laplace approximation of the integrated Soft-MMP function. The line search algorithm is employed to solve this optimization problem. We evaluate the proposed GMM structure selection method through the experiments of handwritten digit recognition on the well-known CENPARMI and MNIST digit databases. Our method behaves better than the manual method and the generative counterparts, including Bayesian Information Criterion (BIC), Minimum Description Length (MDL) and AutoClass.

• Type: Journal
• Year: 2011
• Where: IJON
• Authors: Xuefeng Chen, Xiabi Liu, Yunde Jia
• Keywords: Gaussian Mixture Models, Handwritten Digit Recognition, IJON 2011, Minimum Description Length