On Point Sampling Versus Space Sampling for Dimensionality Reduction

In recent years, random projection has been used as a valuable tool for performing dimensionality reduction of high dimensional data. Starting with the seminal work of Johnson and Lindenstrauss [8], a number of interesting implementations of the random projection techniques have been proposed for dimensionality reduction. These techniques are mostly space symmetric random projections in which random hyperplanes are sampled in order to construct the projection. While these methods can provide effective reductions with worst-case bounds, they are not sensitive to the fact that the underlying data may have much lower implicit dimensionality than the full dimensionality. This may often be the case in many real applications. In this work, we analyze the theoretical effectiveness of point sampled random projections, in which the sampled hyperplanes are defined in terms of points sampled from the data. We show that point sampled random projections can be significantly more effective in ...

• Type: Conference
• Year: 2007
• Where: SDM
• Authors: Charu C. Aggarwal
• Keywords: Data Mining, Dimensionality, Dimensionality Reduction, Random Projections, SDM 2007