Towards efficient event aggregation in a decentralized publish-subscribe system

Recently, decentralized publish-subscribe (pub-sub) systems have gained popularity as a scalable asynchronous messaging paradigm over wide-area networks. Most existing pub-sub systems, however, have been designed with the implicit assumption that published data is clean and accurate. As the pub-sub paradigm is incorporated in real-world applications with human participants, this assumption becomes increasingly invalid due to the inherent noise in the event stream. The noise can take many forms, including redundant, incomplete, inaccurate, and even malicious event messages. This paper explores the distributed computing issues involved in handling event streams with redundant and incomplete messages. Given a distributed broker overlay-based pub-sub system, we present our initial ideas for (1) aggregating event information scattered across multiple messages generated by different publishers and (2) eliminating redundant event messages. Key to our approach is the concept of an event-gathe...

• Type: Conference
• Year: 2009
• Where: DEBS
• Authors: Jianxia Chen, Lakshmish Ramaswamy, David Lowenthal
• Keywords: DEBS 2009, Distributed And Parallel Computing, Event Messages, Event Streams, Redundant Event Messages