WWW
2004
ACM
15 years 6 days ago
2004
ACM
The massive distribution of the crawling task can lead to inefficient exploration of the same portion of the Web. We propose a technique to guide crawlers exploration based on the...