209 search results - page 5 / 42 » To search or to crawl |
WWW
2007
ACM
14 years 10 months ago
2007
ACM
Near-duplicate web documents are abundant. Two such documents differ from each other in a very small portion that displays advertisements, for example. Such differences are irrele...
WWW
2005
ACM
14 years 10 months ago
2005
ACM
Focused crawlers are considered as a promising way to tackle the scalability problem of topic-oriented or personalized search engines. To design a focused crawler, the choice of s...
WWW
2008
ACM
14 years 10 months ago
2008
ACM
This paper proposes a method of crawling Web servers connected to the Internet without imposing a high processing load. We are using the crawler for a field survey of the digital ...
WWW
2004
ACM
14 years 10 months ago
2004
ACM
The massive distribution of the crawling task can lead to inefficient exploration of the same portion of the Web. We propose a technique to guide crawlers exploration based on the...
CORR
2012
Springer
12 years 5 months ago
2012
Springer
A typical web search engine consists of three principal parts: crawling engine, indexing engine, and searching engine. The present work aims to optimize the performance of the cra...