Fast dimension reduction using Rademacher series on dual BCH codes

The Fast Johnson-Lindenstrauss Transform (FJLT) was recently discovered by Ailon and Chazelle as a novel technique for performing fast dimension reduction with small distortion from d 2 to k 2 in time O(max{d log d, k3 }). For k in [(log d), O(d1/2 )] this beats time O(dk) achieved by naive multiplication by random dense matrices, an approach followed by several authors as a variant of the seminal result by Johnson and Lindenstrauss (JL) from the mid 80's. In this work we show how to significantly improve the running time to O(d log k) for k = O(d1/2), for any arbitrary small fixed . This beats the better of FJLT and JL. Our analysis uses a powerful measure concentration bound due to Talagrand applied to Rademacher series in Banach spaces (sums of vectors in Banach spaces with random signs). The set of vectors used is a real embedding of dual BCH code vectors over GF(2). We also discuss the number of random bits used and reduction to 1 space. The connection between geometry and d...

• Type: Conference
• Year: 2008
• Where: SODA
• Authors: Nir Ailon, Edo Liberty
• Keywords: Algorithms, Fast Dimension Reduction, Log D, Random Dense Matrices, SODA 2008