Optimizing Timestamp Management in Data Stream Management Systems

It has long been recognized that multi-stream operators, such as union and join, often have to wait idly in a temporarily blocked state, as a result of skews between the timestamps of their input streams. Recently, it has been shown that the injection of heartbeat information through punctuation tuples can alleviate this problem. In this paper, we propose and investigate more effective solutions that use timestamps generated on-demand to reactivate idle-waiting operators. We thus introduce a simple execution model that efficiently supports on-demand punctuations. Experiments show that response time and memory usage are reduced substantially by this approach.

• Type: Conference
• Year: 2007
• Where: ICDE
• Authors: Yijian Bai, Hetal Thakkar, Haixun Wang, Carlo Zaniolo
• Keywords: Database, ICDE 2007, Input Streams, On-demand Punctuations, Simple Execution Model