From a Stream of Relational Queries to Distributed Stream Processing

Applications from several domains are now being written to process live data originating from hardware and softwarebased streaming sources. Many of these applications have been written relying solely on database and data warehouse technologies, despite their lack of need for transactional support and ACID properties. In several extreme high-load cases, this approach does not scale to the processing speeds that these applications demand. In this paper we demonstrate an application acceleration approach whereby a regular ODBC-based application is converted into a true streaming application with minimal disruption from a software engineering standpoint. We showcase our approach on three real-world applications. We experimentally demonstrate the substantial performance improvements that can be observed when contrasting the accelerated implementation with the original database-oriented implementation. Categories and Subject Descriptors H.2.4 [Database Management]: Systems—Distributed dat...

• Type: Journal
• Year: 2010
• Where: PVLDB
• Authors: Qiong Zou, Huayong Wang, Robert Soulé, Martin Hirzel, Henrique Andrade, Bugra Gedik, Kun-Lung Wu
• Keywords: Application Acceleration Approach, Original Database-oriented Implementation, PVLDB 2010, True Streaming Application