Online Dynamic Reordering for Interactive Data Processing

We present a pipelining, dynamically usercontrollable reorder operator, for use in dataintensive applications. Allowing the user to reorder the data delivery on the fly increases the interactivity in several contexts such as online aggregation and large-scale spreadsheets; it allows the user to control the processing of data by dynamically specifying preferences for different data items based on prior feedback, so that data of interest is prioritized for early processing. We describe an efficient, non-blocking mechanism for reordering, which can be used over arbitrary data streams from files, indexes, and continuous data feeds. We also investigate several policies for the reordering based on the performance goals of various typical applications. We present results from an implementation used in Online Aggregation in the Informix Dynamic Server with Universal Data Option, and in sorting and scrolling in a large-scale spreadsheet. Our experiments demonstrate that for a variety of dat...

• Type: Conference
• Year: 1999
• Where: VLDB
• Authors: Vijayshankar Raman, Bhaskaran Raman, Joseph M. Hellerstein
• Keywords: Database, Large-scale Spreadsheet, Online Aggregation, Usercontrollable Reorder Operator, VLDB 1999