Progressive and selective merge: computing top-k with ad-hoc ranking functions

The family of threshold algorithm (i.e., TA) has been widely studied for efficiently computing top-k queries. TA uses a sort-merge framework that assumes data lists are pre-sorted, and the ranking functions are monotone. However, in many database applications, attribute values are indexed by treestructured indices (e.g., B-tree, R-tree), and the ranking functions are not necessarily monotone. To answer top-k queries with ad-hoc ranking functions, this paper studies an index-merge paradigm that performs progressive search over the space of joint states composed by multiple index nodes. We address two challenges for efficient query processing. First, to minimize the search complexity, we present a doubleheap algorithm which supports not only progressive state search but also progressive state generation. Second, to avoid unnecessary disk access, we characterize a type of "empty-state" that does not contribute to the final results, and propose a new materialization model, join-...

• Type: Conference
• Year: 2007
• Where: SIGMOD
• Authors: Dong Xin, Jiawei Han, Kevin Chen-Chuan Chang
• Keywords: Ad-hoc Ranking Functions, Database, Progressive State Generation, Progressive State Search, SIGMOD 2007