Data Mining on an OLTP System (Nearly) for Free

This paper proposes a scheme for scheduling disk requests that takes advantage of the ability of high-level functions to operate directly at individual disk drives. We show that such a scheme makes it possible to support a Data Mining workload on an OLTP system almost for free: there is only a small impact on the throughput and response time of the existing workload. Specifically, we show that an OLTP system has the disk resources to consistently provide one third of its sequential bandwidth to a background Data Mining task with close to zero impact on OLTP throughput and response time at high transaction loads. At low transaction loads, we show much lower impact than observed in previous work. This means that a production OLTP system can be used for Data Mining tasks without the expense of a second dedicated system. Our scheme takes advantage of close interaction with the on-disk scheduler by reading blocks for the Data Mining workload as the disk head “passes over” them while sa...

• Type: Conference
• Year: 2000
• Where: SIGMOD
• Authors: Erik Riedel, Christos Faloutsos, Gregory R. Ganger, David Nagle
• Keywords: Data Mining, Data Mining Workload, Database, OLTP, SIGMOD 2000