326 search results - page 4 / 66 » Optimal crawling strategies for web search engines |
ERCIMDL
2005
Springer
14 years 28 days ago
2005
Springer
Vertical search engines and web portals are gaining ground over the general-purpose engines due to their limited size and their high precision for the domain they cover. The number...
SIGIR
2009
ACM
14 years 1 months ago
2009
ACM
Crawl selection policy has a direct influence on Web search effectiveness, because a useful page that is not selected for crawling will also be absent from search results. Yet th...
JIS
2008
13 years 6 months ago
2008
This paper deals with one aspect of the index quality of search engines: index freshness. The purpose is to analyse the update strategies of the major Web search engines Google, Y...
HT
2006
ACM
14 years 1 months ago
2006
ACM
We have developed a web-repository crawler that is used for reconstructing websites when backups are unavailable. Our crawler retrieves web resources from the Internet Archive, Go...
WWW
2009
ACM
14 years 8 months ago
2009
ACM
Comprehensive coverage of the public web is crucial to web search engines. Search engines use crawlers to retrieve pages and then discover new ones by extracting the pages' o...