Adaptive Sampling and Fast Low-Rank Matrix Approximation

We prove that any real matrix A contains a subset of at most 4k/ + 2k log(k + 1) rows whose span "contains" a matrix of rank at most k with error only (1 + ) times the error of the best rank-k approximation of A. We complement it with an almost matching lower bound by constructing matrices where the span of any k/2 rows does not "contain" a relative (1 + )-approximation of rank k. Our existence result leads to an algorithm that finds such rank-k approximation in time O M k + k2 log k + (m + n) k2 2 + k3 log k + k4 log2 k , i.e., essentially O(Mk/ ), where M is the number of nonzero entries of A. The algorithm maintains sparsity, and in the streaming model [12, 14, 15], it can be implemented using only 2(k + 1)(log(k + 1) + 1) passes over the input matrix and O min{m, n}(k + k2 log k)

• Type: Conference
• Year: 2006
• Where: APPROX
• Authors: Amit Deshpande, Santosh Vempala
• Keywords: Algorithms, APPROX 2006, Lower Bound, Rank-k Approximation, Real Matrix