Parallel ROLAP Data Cube Construction On Shared-Nothing Multiprocessors

The pre-computation of data cubes is critical to improving the response time of On-Line Analytical Processing (OLAP) systems and can be instrumental in accelerating data mining tasks in large data warehouses. In order to meet the need for improved performance created by growing data sizes, parallel solutions for generating the data cube are becoming increasingly important. This paper presents a parallel method for generating data cubes on a shared-nothing multiprocessor. Since no (expensive) shared disk is required, our method can be used on low cost Beowulf style clusters consisting of standard PCs with local disks connected via a data switch. Our approach uses a ROLAP representation of the data cube where views are stored as relational tables. This allows for tight integration with current relational database technology. We have implemented our parallel shared-nothing data cube generation method and evaluated it on a PC cluster, exploring relative speedup, local vs. global schedule t...

• Type: Conference
• Year: 2003
• Where: IPPS
• Authors: Ying Chen, Frank K. H. A. Dehne, Todd Eavis, Andrew Rau-Chaplin
• Keywords: Data Cube, Data Cube Generation, Distributed And Parallel Computing, Input Data Set, IPPS 2003