QPipe: A Simultaneously Pipelined Relational Query Engine

Relational DBMS typically execute concurrent queries independently by invoking a set of operator instances for each query. To exploit common data retrievals and computation in concurrent queries, researchers have proposed a wealth of techniques, ranging from buffering disk pages to constructing materialized views and optimizing multiple queries. The ideas proposed, however, are inherently limited by the query-centric philosophy of modern engine designs. Ideally, the query engine should proactively coordinate same-operator execution among concurrent queries, thereby exploiting common accesses to memory and disks as well as common intermediate result computation. This paper introduces on-demand simultaneous pipelining (OSP), a novel query evaluation paradigm for maximizing data and work sharing across concurrent queries at execution time. OSP enables proactive, dynamic operator sharing by pipelining the operator's output simultaneously to multiple parent nodes. This paper also intr...

• Type: Conference
• Year: 2005
• Where: SIGMOD
• Authors: Stavros Harizopoulos, Vladislav Shkapenyuk, Anastassia Ailamaki
• Keywords: Concurrent Queries, Database, Multiple Queries, SIGMOD 2005, TPC-H Queries