Self-organizing tuple reconstruction in column-stores

Column-stores gained popularity as a promising physical design alternative. Each attribute of a relation is physically stored as a separate column allowing queries to load only the required attributes. The overhead incurred is on-the-fly tuple reconstruction for multi-attribute queries. Each tuple reconstruction is a join of two columns based on tuple IDs, making it a significant cost component. The ultimate physical design is to have multiple presorted copies of each base table such that tuples are already appropriately organized in multiple different orders across the various columns. This requires the ability to predict the workload, idle time to prepare, and infrequent updates. In this paper, we propose a novel design, partial sideways cracking, that minimizes the tuple reconstruction cost in a self-organizing way. It achieves performance similar to using presorted data, but without requiring the heavy initial presorting step itself. Instead, it handles dynamic, unpredictable w...

• Type: Conference
• Year: 2009
• Where: SIGMOD
• Authors: Stratos Idreos, Martin L. Kersten, Stefan Manegold
• Keywords: Database, Multi-attribute Queries, Physical Design, SIGMOD 2009, Tuple Reconstruction