Optimization of Continuous Queries in Federated Database and Stream Processing Systems

: The constantly increasing number of connected devices and sensors results in increasing volume and velocity of sensor-based streaming data. Traditional approaches for processing high velocity sensor data rely on stream processing engines. However, the increasing complexity of continuous queries executed on top of high velocity data has resulted in growing demand for federated systems composed of data stream processing engines and database engines. One of major challenges for such systems is to devise the optimal query execution plan to maximize the throughput of continuous queries. In this paper we present a general framework for federated database and stream processing systems, and introduce the design and implementation of a cost-based optimizer for optimizing relational continuous queries in such systems. Our optimizer uses characteristics of continuous queries and source data streams to devise an optimal placement for each operator of a continuous query. This fine level of optim...

• Type: Journal
• Year: 2015
• Where: BTW
• Authors: Yuanzhen Ji, Zbigniew Jerzak, Anisoara Nica, Gregor Hackenbroich, Christof Fetzer
• Keywords: BTW 2015, Database