Event-based systems: opportunities and challenges at exascale

Streaming data models have been shown to be useful in many applications requiring high-performance data exchange. Application-level overlay networks are a natural way to realize these applications’ data flows and their internal computations, but existing middleware is not designed to scale to the data rates and low overhead computations necessary for the high performance domain. This paper describes EVPath, a middleware infrastructure that supports the construction and management of overlay networks that can be customized both in topology and in the data manipulations being performed. Extending from a previous highperformance publish-subscribe system, EVPath not only provides for the low overhead movement and in-line processing of large data volumes, but also offers the flexibility needed to support the varied data flow and control needs of alternative higher-level streaming models. We explore some of the challenges of high performance event systems, including those experienced ...

• Type: Conference
• Year: 2009
• Where: DEBS
• Authors: Greg Eisenhauer, Matthew Wolf, Hasan Abbasi, Karsten Schwan
• Keywords: Data flow, DEBS 2009, Distributed And Parallel Computing, Low Overhead, Overlay Networks