A Fast Content-Based Data Distribution Infrastructure

— We present Sieve – an infrastructure for fast content-based data distribution to interested users. The ability of Sieve to filter and forward high-bandwidth data streams stems from its distributed pipelined architecture. The complex message filtering task is broken-up into a sequence of light-weight filtering components resulting in high end-to-end throughput. Furthermore, since each component is assigned to a node based on its resource constraints, the queue buildup inside the nodes is minimal resulting in low end-to-end latency. Our experimental results based on real system implementation show that Sieve can sustain a throughput of more than 5000 messages per second for 100000 subscriptions with predicates of 10 attributes.

• Type: Conference
• Year: 2006
• Where: INFOCOM
• Authors: Samrat Ganguly, Sudeept Bhatnagar, Akhilesh Saxena, Rauf Izmailov, Suman Banerjee
• Keywords: Communications, Fast Content-based Data, INFOCOM 2006, Light-weight filtering Components, Low End-to-end Latency