LOCUST: An Online Analytical Processing Framework for High Dimensional Classification of Data Streams

Abstract-- In recent years, data streams have become ubiquitous because of advances in hardware and software technology. The ability to adapt conventional mining problems to data streams is a great challenge in a data stream environment. Many data streams are inherently high dimensional, which creates a special challenge for data mining algorithms. In this paper, we consider the problem of classification of high dimensional data streams. For the high dimensional case, even traditional classifiers do not work very well on fixed data sets. We discuss a number of insights for the intractability of the high dimensional case. We use these insights to propose a new classification method (LOCUST) which avoids many of these weaknesses. The key is to develop a subspace-based instance centered classification approach which can be implemented efficiently for a fast data stream. We propose a methodology to effectively process the data stream in an organized way, so that the intermediate data struc...

• Type: Conference
• Year: 2008
• Where: ICDE
• Authors: Charu C. Aggarwal, Philip S. Yu
• Keywords: Database, Dimensional Data Streams, Fast Data Stream, ICDE 2008, Many Data Streams