COFI-tree Mining: A New Approach to Pattern Growth with Reduced Candidacy Generation

Existing association rule mining algorithms suffer from many problems when mining massive transactional datasets. Some of these major problems are: (1) the repetitive I/O disk scans, (2) the huge computation involved during the candidacy generation, and (3) the high memory dependency. This paper presents the implementation of our frequent itemset mining algorithm, COFI, which achieves its efficiency by applying four new ideas. First, it can mine using a compact memory based data structures. Second, for each frequent item assigned, a relatively small independent tree is built summarizing co-occurrences. Third, clever pruning reduces the search space drastically. Finally, a simple and non-recursive mining process reduces the memory requirements as minimum candidacy generation and counting is needed to generate all relevant frequent patterns.

• Type: Conference
• Year: 2003
• Where: FIMI
• Authors: Osmar R. Zaïane, Mohammad El-Hajj
• Keywords: Candidacy Generation, Data Mining, FIMI 2003, Frequent Itemset Mining, Mining Algorithm