StreaMon: An Adaptive Engine for Stream Query Processing

StreaMon is the adaptive query processing engine of the STREAM prototype Data Stream Management System (DSMS) [4]. A fundamental challenge in many DSMS applications (e.g., network monitoring, financial monitoring over stock tickers, sensor processing) is that conditions may vary significantly over time. Since queries in these systems are usually long-running, or continuous [4], it is important to consider adaptive approaches to query processing. Without adaptivity, performance may drop drastically as stream data and arrival characteristics, query loads, and system conditions change over time. StreaMon uses several techniques to support adaptive query processing [1, 2, 3]; we demonstrate three of them: ? Reducing run-time memory requirements for continuous queries by exploiting stream data and arrival patterns. ? Adaptive join ordering for pipelined multiway stream joins, with strong quality guarantees. ? Placing subresult caches adaptively in pipelined multiway stream joins to avoid r...

• Type: Conference
• Year: 2004
• Where: SIGMOD
• Authors: Shivnath Babu, Jennifer Widom
• Keywords: Adaptive Query Processing, Database, Multiway Stream, SIGMOD 2004, Stream Prototype Data