A Framework for Clustering Massive-Domain Data Streams

In this paper, we will examine the problem of clustering massive domain data streams. Massive-domain data streams are those in which the number of possible domain values for each attribute are very large and cannot be easily tracked for clustering purposes. Some examples of such streams include IP-address streams, credit-card transaction streams, or streams of sales data over large numbers of items. In such cases, it is well known that even simple stream operations such as counting can be extremely difficult because of the difficulty in maintaining summary information over the different discrete values. The task of clustering is significantly more challenging in such cases, since the intermediate statistics for the different clusters cannot be maintained efficiently. In this paper, we propose a method for clustering massive-domain data streams with the use of sketches. We prove probabilistic results which show that a sketch-based clustering method can provide similar results to an infi...

• Type: Conference
• Year: 2009
• Where: ICDE
• Authors: Charu C. Aggarwal
• Keywords: Credit-card Transaction Streams, Database, ICDE 2009, Infinitespace Clustering Algorithm, IP-address Streams, Massive-domain Data Streams, Sketch-based Clustering Method