Attack-resistant frequency counting

We present collaborative peer-to-peer algorithms for the problem of approximating frequency counts for popular items distributed across the peers of a large-scale network. Our algorithms are attack-resistant in the sense that they function correctly even in the case where an adaptive and computationally unbounded adversary causes up to a 1/3 fraction of the peers in the network to suffer Byzantine faults. Our algorithms are scalable in the sense that all resource costs are polylogarithmic. Specifically, latency is O(log n); the number of messages and number of bits sent and received by each peer is O(log2 n) per item; and number of neighbors of each peer is O(log2 n). Our motivation for addressing this problem is to provide a tool for the following three applications: worm and virus detection; spam detection; and distributed data-mining. To the best of our knowledge, our algorithms are the first attack-resistant and scalable algorithms for this problem. Moreover, surprisingly, our alg...

• Type: Journal
• Year: 2010
• Where: IPPS
• Authors: Bo Wu, Jared Saia, Valerie King
• Keywords: Algorithms, Collaborative Peer-to-peer Algorithms, Data Mining Problem, Distributed And Parallel Computing, IPPS 2010