Frequent Itemset Discovery with SQL Using Universal Quantification

Algorithms for finding frequent itemsets fall into two broad classes: (1) algorithms that are based on non-trivial SQL statements to query and update a database, and (2) algorithms that employ sophisticated in-memory data structures, where the data is stored into and retrieved from flat files. Most performance experiments have shown that SQL-based approaches are inferior to mainmemory algorithms. However, the current trend of database vendors to integrate analysis functionalities into their query execution and optimization components, i.e., “closer to the data,” suggests revisiting these results and searching for new, potentially better solutions. We investigate approaches based on SQL92 and present a new approach called Quiver that employs universal and existential quantifications. This approach uses a table layout for itemsets, where a group of multiple records represents a single itemset. Hence, such a vertical layout is similar to the popular layout used for the transaction tab...

• Type: Conference
• Year: 2004
• Where: CINQ
• Authors: Ralf Rantzau
• Keywords: CINQ 2004, Database, Frequent Itemset, Non-trivial Sql Statements, Sophisticated In-memory Data