Stormy: an elastic and highly available streaming service in the cloud

In recent years, new highly scalable storage systems have significantly contributed to the success of Cloud Computing. Systems like Dynamo or Bigtable have underpinned their ability to handle tremendous amounts of data and scale to a very large number of nodes. Although these systems are designed the store data, the fundamental architectural properties and the techniques used (e.g., request routing, replication and load balancing) can also be applied to data streaming systems. In this paper, we present Stormy, a distributed stream processing service for continuous data processing. Stormy is based on proven techniques from existing Cloud storage systems that are adapted to e ciently execute streaming workloads. The primary design focus lies in providing a scalable, elastic, and fault-tolerant framework for continuous data processing, while at the same time optimizing resource utilization and increasing cost e ciency. Stormy is able to process any kind of streaming workloads, thus, cov...

• Type: Journal
• Year: 2012
• Where: EDBT
• Authors: Simon Loesing, Martin Hentschel, Tim Kraska, Donald Kossmann
• Keywords: Architectural Properties, Database, Design Focus, EDBT 2012, Realtime Data