WWW
2008
ACM
15 years 6 days ago
2008
ACM
It is crucial for a web crawler to distinguish between ephemeral and persistent content. Ephemeral content (e.g., quote of the day) is usually not worth crawling, because by the t...