299 search results - page 22 / 60 » User-centric Web crawling |
WWW
2002
ACM
14 years 9 months ago
2002
ACM
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish d...
CAISE
2010
Springer
13 years 7 months ago
2010
Springer
Search computing is a novel discipline whose goal is to answer complex, multi-domain queries. Such queries typically require combining in their results domain knowledge extracted ...
WWW
2008
ACM
14 years 9 months ago
2008
ACM
This paper shares our experience in designing a web crawler that can download billions of pages using a single-server implementation and models its performance. We show that with ...
JIS
2008
13 years 8 months ago
2008
This paper deals with one aspect of the index quality of search engines: index freshness. The purpose is to analyse the update strategies of the major Web search engines Google, Y...
WWW
2008
ACM
14 years 9 months ago
2008
ACM
We study in this paper the Web forum crawling problem, which is a very fundamental step in many Web applications, such as search engine and Web data mining. As a typical user-crea...