295 search results - page 15 / 59 » Web Crawling |
CN
1998
13 years 9 months ago
1998
In this paper we study in what order a crawler should visit the URLs it has seen, in order to obtain more "important" pages first. Obtaining important pages rapidly can ...
HT
2006
ACM
14 years 3 months ago
2006
ACM
We have developed a web-repository crawler that is used for reconstructing websites when backups are unavailable. Our crawler retrieves web resources from the Internet Archive, Go...
CORR
2012
Springer
12 years 5 months ago
2012
Springer
A typical web search engine consists of three principal parts: crawling engine, indexing engine, and searching engine. The present work aims to optimize the performance of the cra...
SIGIR
2002
ACM
13 years 9 months ago
2002
ACM
We measure the WT10g test collection, used in the TREC-9 and TREC 2001 Web Tracks, and the .GOV test collection used in the TREC 2002 Web and Interactive Tracks, with common measu...
ICAPR
2005
Springer
14 years 3 months ago
2005
Springer
The number of vertical search engines and portals has rapidly increased over the last years, making the importance of a topic-driven (focused) crawler evident. In this paper, we de...