On sampling-based approximate spectral decomposition

This paper addresses the problem of approximate singular value decomposition of large dense matrices that arises naturally in many machine learning applications. We discuss two recently introduced sampling-based spectral decomposition techniques: the Nystr?om and the Column-sampling methods. We present a theoretical comparison between the two methods and provide novel insights regarding their suitability for various applications. We then provide experimental results motivated by this theory. Finally, we propose an efficient adaptive sampling technique to select informative columns from the original matrix. This novel technique outperforms standard sampling methods on a variety of datasets.

• Type: Conference
• Year: 2009
• Where: ICML
• Authors: Sanjiv Kumar, Mehryar Mohri, Ameet Talwalkar
• Keywords: Adaptive Sampling Technique, ICML 2009, Machine Learning, Singular Value Decomposition, Standard Sampling Methods