Database-support for Continuous Prediction Queries over Streaming Data

Prediction is emerging as an essential ingredient for real-time monitoring, planning and decision support applications such as intrusion detection, e-commerce pricing and automated resource management. This paper presents a system that efficiently supports continuous prediction queries (CPQs) over streaming data using seamlessly-integrated probabilistic models. Specifically, we describe how to execute and optimize CPQs using discrete (Dynamic) Bayesian Networks as the underlying predictive model. Our primary contribution is a novel cost-based optimization framework that employs materialization, sharing, and model-specific optimization techniques to enable highly-efficient point- and range-based CPQ execution. Furthermore, we support efficient execution of top-k and threshold-based high probability queries. We characterize the behavior of our system and demonstrate significant performance gains using a prototype implementation operating on realworld network intrusion data and dep...

• Type: Journal
• Year: 2010
• Where: PVLDB
• Authors: Mert Akdere, Ugur Çetintemel, Eli Upfal
• Keywords: Model-specific Optimization Techniques, PVLDB 2010, Range-based Cpq Execution, Realworld Network Intrusion