Sciweavers

472 search results - page 6 / 95
» Crawling the Hidden Web
Sort
View
WWW
2003
ACM
14 years 8 months ago
Distributed Indexing of the Web Using Migrating Crawlers
Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge...
Odysseas Papapetrou, Stavros Papastavrou, George S...
SIGIR
2009
ACM
14 years 2 months ago
The impact of crawl policy on web search effectiveness
Crawl selection policy has a direct influence on Web search effectiveness, because a useful page that is not selected for crawling will also be absent from search results. Yet th...
Dennis Fetterly, Nick Craswell, Vishwa Vinay
WWW
2006
ACM
14 years 8 months ago
Effective web-scale crawling through website analysis
The web crawler space is often delimited into two general areas: full-web crawling and focused crawling. We present netSifter, a crawler system which integrates features from thes...
Iván Gonzlez, Adam Marcus 0002, Daniel N. M...
ADBIS
2004
Springer
113views Database» more  ADBIS 2004»
14 years 29 days ago
Ipmicra: Toward a Distributed and Adaptable Location Aware Web Crawler
Abstract. Distributed crawling has shown that it can overcome important limitations of the centralized crawling paradigm. However, the distributed nature of current distributed cra...
Odysseas Papapetrou, George Samaras
ITSSA
2006
581views more  ITSSA 2006»
13 years 7 months ago
Agent-Based Approach for Web Crawling
: Since its creation in 1990, World Wide Web has increased the popularity of Internet which becomes an important source of information or services for all people over the world. Th...
Maxime Wack, Mohamed Bakhouya, Jaafar Gaber