295 search results - page 20 / 59 » Web Crawling |
WWW
2002
ACM
14 years 10 months ago
2002
ACM
In this paper we study how we can design an effective parallel crawler. As the size of the Web grows, it becomes imperative to parallelize a crawling process, in order to finish d...
ADCS
2004
13 years 11 months ago
2004
Previous work on domain specific search services in the area of depressive illness has documented the significant human cost required to setup and maintain closed-crawl parameters....
SIGMOD
2006
ACM
14 years 10 months ago
2006
ACM
Text is ubiquitous and, not surprisingly, many important applications rely on textual data for a variety of tasks. As a notable example, information extraction applications derive...
ICMLA
2008
13 years 11 months ago
2008
This paper presents a software system that is able to generate crosswords with no human intervention including definition generation and crossword compilation. In particular, the ...
WWW
2008
ACM
14 years 10 months ago
2008
ACM
This paper shares our experience in designing a web crawler that can download billions of pages using a single-server implementation and models its performance. We show that with ...