Dynamicity vs. effectiveness: studying online clustering for scatter/gather

We proposed and implemented a novel clustering algorithm called LAIR2, which has constant running time average for on-the-fly Scatter/Gather browsing [4]. Our experiments showed that when running on a single processor, the LAIR2 on-line clustering algorithm was several hundred times faster than a parallel Buckshot algorithm running on multiple processors [11]. This paper reports on a study that examined the effectiveness of the LAIR2 algorithm in terms of clustering quality and its impact on retrieval performance. We conducted a user study on 24 subjects to evaluate on-the-fly LAIR2 clustering in Scatter/Gather search tasks by comparing its performance to the Buckshot algorithm, a classic method for Scatter/Gather browsing [4]. Results showed significant differences in terms of subjective perceptions of clustering quality. Subjects perceived that the LAIR2 algorithm produced significantly better quality clusters than the Buckshot method did. Subjects felt that it took less effo...

• Type: Conference
• Year: 2009
• Where: SIGIR
• Authors: Weimao Ke, Cassidy R. Sugimoto, Javed Mostafa
• Keywords: Buckshot Algorithm, Clustering Algorithm, Information Retrieval, On-line Clustering Algorithm, SIGIR 2009