178 search results - page 6 / 36 » Scheduling Algorithms for Web Crawling |
WWW
2007
ACM
14 years 8 months ago
2007
ACM
This paper reports a new general framework of focused web crawling based on "relational subgroup discovery". Predicates are used explicitly to represent the relevance cl...
CIKM
2011
Springer
12 years 7 months ago
2011
Springer
Word prediction performed by language models has an important role in many tasks as e.g. word sense disambiguation, speech recognition, hand-writing recognition, query spelling an...
ICML
2007
IEEE
14 years 8 months ago
2007
IEEE
In this paper we propose a novel, scalable, clustering based Ordinal Regression formulation, which is an instance of a Second Order Cone Program (SOCP) with one Second Order Cone ...
WWW
2008
ACM
14 years 8 months ago
2008
ACM
This paper shares our experience in designing a web crawler that can download billions of pages using a single-server implementation and models its performance. We show that with ...
INTR
2002
13 years 7 months ago
2002
There have been many attempts to study the content of the web, either through human or automatic agents. Five different previously used web survey methodologies are described and ...