Mutual Information in Learning Feature Transformations

We present feature transformations useful for exploratory data analysis or for pattern recognition. Transformations are learned from example data sets by maximizing the mutual information between transformed data and their class labels. We make use of Renyi’s quadratic entropy, and we extend the work of Principe et al. to mutual information between continuous multidimensional variables and discrete-valued class labels.

• Type: Conference
• Year: 2000
• Where: ICML
• Authors: Kari Torkkola, William M. Campbell
• Keywords: Class Labels, Exploratory Data Analysis, ICML 2000, Machine Learning, Mutual Information