A Very Fast Method for Clustering Big Text Datasets

Large-scale text datasets have long eluded a family of particularly elegant and effective clustering methods that exploits the power of pair-wise similarities between data points due to the prohibitive cost, time- and space-wise, in operating on a similarity matrix, where the state-of-the-art is at best quadratic in time and in space. We present an extremely fast and simple method also using the power of all pair-wise similarity between data points, and show through experiments that it does as well as previous methods in clustering accuracy, and it does so with in linear time and space, without sampling data points or sparsifying the similarity matrix.

• Type: Conference
• Year: 2010
• Where: ECAI
• Authors: Frank Lin, William W. Cohen
• Keywords: Artificial Intelligence, Data Points, ECAI 2010, Effective Clustering Methods, Similarity Matrix