A Probabilistic Model Using Information Theoretic Measures for Cluster Ensembles

Abstract. This paper presents a probabilistic model for combining cluster ensembles utilizing information theoretic measures. Starting from a co-association matrix which summarizes the ensemble, we extract a set of association distributions, which are modelled as discrete probability distributions of the object labels, conditional on each data object. The key objectives are, first, to model the associations of neighboring data objects, and second, to allow for the manipulation of the defined probability distributions using statistical and information theoretic means. A Jensen-Shannon Divergence based Clustering Combination (JSDCC) method is proposed. The method selects cluster prototypes from the set of association distributions based on entropy maximization and maximization of the generalized JS divergence among the selected prototypes. The method proceeds by grouping association distributions by minimizing their JS divergences to the selected prototypes. By aggregating the grouped ...

• Type: Conference
• Year: 2004
• Where: MCS
• Authors: Hanan Ayad, Otman A. Basir, Mohamed Kamel
• Keywords: Association Distributions, Data Objects, MCS 2004, Pattern Recognition, Probability Distributions