Association Rule Mining in Peer-to-Peer Systems

We extend the problem of association rule mining – a key data mining problem – to systems in which the database is partitioned among a very large number of computers that are dispersed over a wide area. Such computing systems include GRID computing platforms, federated database systems, and peer-to-peer computing environments. The scale of these systems poses several difficulties, such as the impracticality of global communications and global synchronization, dynamic topology changes of the network, on-the-fly data updates, the need to share resources with other applications, and the frequent failure and recovery of resources. We present an algorithm by which every node in the system can reach the exact solution, as if it were given the combined database. The algorithm is entirely asynchronous, imposes very little communication overhead, transparently tolerates network topology changes and node failures, and quickly adjusts to changes in the data as they occur. Simulation of up ...

• Type: Conference
• Year: 2003
• Where: ICDM
• Authors: Ran Wolff, Assaf Schuster
• Keywords: Data Mining, Data Mining Problem, ICDM 2003, Such Computing Systems, Topology Changes