The 8 requirements of real-time stream processing

Applications that require real-time processing of high-volume data steams are pushing the limits of traditional data processing infrastructures. These stream-based applications include market feed processing and electronic trading on Wall Street, network and infrastructure monitoring, fraud detection, and command and control in military environments. Furthermore, as the "sea change" caused by cheap micro-sensor technology takes hold, we expect to see everything of material significance on the planet get "sensor-tagged" and report its state or location in real time. This sensorization of the real world will lead to a "green field" of novel monitoring and control applications with high-volume and low-latency processing requirements. Recently, several technologies have emerged--including off-theshelf stream processing engines--specifically to address the challenges of processing high-volume, real-time data without requiring the use of custom code. At the sam...

• Type: Conference
• Year: 2005
• Where: SIGMOD
• Authors: Michael Stonebraker, Ugur Çetintemel, Stanley B. Zdonik
• Keywords: Alternative Stream Processing, Database, Low-latency Processing Requirements, Real-time Stream Processing, SIGMOD 2005