Fine: Information embedding for document classification

The problem of document classification considers categorizing or grouping of various document types. Each document can be represented as a bag of words, which has no straightforward Euclidean representation. Relative word counts form the basis for similarity metrics among documents. Endowing the vector of term frequencies with a Euclidean metric has no obvious straightforward justification. A more appropriate assumption commonly used is that the data lies on a statistical manifold, or a manifold of probabilistic generative models. In this paper, we propose calculating a low-dimensional, information based embedding of documents into Euclidean space. One component of our approach motivated by information geometry is the Fisher information distance to define similarities between documents. The other component is the calculation of the Fisher metric over a lower dimensional statistical manifold estimated in a nonparametric fashion from the data. We demonstrate that in the classificati...

• Type: Conference
• Year: 2008
• Where: ICASSP
• Authors: Kevin M. Carter, Raviv Raich, Alfred O. Hero
• Keywords: Euclidean Metric, ICASSP 2008, Signal Processing, Statistical Manifold, Straightforward Euclidean Representation