Sketching Streams Through the Net: Distributed Approximate Query Tracking

Emerging large-scale monitoring applications require continuous tracking of complex dataanalysis queries over collections of physicallydistributed streams. Effective solutions have to be simultaneously space/time efficient (at each remote monitor site), communication efficient (across the underlying communication network), and provide continuous, guaranteed-quality approximate query answers. In this paper, we propose novel algorithmic solutions for the problem of continuously tracking a broad class of complex aggregate queries in such a distributed-streams setting. Our tracking schemes maintain approximate query answers with provable error guarantees, while simultaneously optimizing the storage space and processing time at each remote site, and the communication cost across the network. They rely on tracking general-purpose randomized sketch summaries of local streams at remote sites along with concise prediction models of local site behavior in order to produce highly communication...

• Type: Conference
• Year: 2005
• Where: VLDB
• Authors: Graham Cormode, Minos N. Garofalakis
• Keywords: Approximate Query, Approximate Query Answers, Database, Guaranteed-quality Approximate Query, VLDB 2005