Snapshot Processing in Streaming Environments

Monitoring and correlation of streaming data from multiple sources is becoming increasingly important in many application areas. Example applications include automated commodities trading, medical monitoring, and the detection of security threats such as biological and chemical weapons. Such monitoring and correlation applications are ideal for deployment on distributed computing grids, because they have high transaction throughput, require low latency, and can be partitioned into sets of small communicating computations with regular communication patterns. An important consideration in these applications is the need to ensure that, at any given time, computations are carried out on an accurate--or at least close to accurate-picture of the environment being monitored. One way of doing this, which we call "snapshot processing", is to treat collections of events that occur at approximately the same time as representing a global snapshot--a valid state--of the environment. Comp...

• Type: Journal
• Year: 2006
• Where: GRID
• Authors: Daniel M. Zimmerman, K. Mani Chandy
• Keywords: Computations, Distributed And Parallel Computing, GRID 2006, Snapshot Processing, Streaming Data