23 search results - page 2 / 5 » On near-uniform URL sampling |
WWW
2006
ACM
14 years 1 months ago
2006
ACM
We consider the problem of dust: Different URLs with Similar Text. Such duplicate URLs are prevalent in web sites, as web server software often uses aliases and redirections, and...
WWW
2010
ACM
14 years 2 months ago
2010
ACM
Duplicate URLs have brought serious troubles to the whole pipeline of a search engine, from crawling, indexing, to result serving. URL normalization is to transform duplicate URLs...
WWW
2008
ACM
14 years 8 months ago
2008
ACM
A bipartite query-URL graph, where an edge indicates that a document was clicked for a query, is a useful construct for finding groups of related queries and URLs. Here we use thi...
STACS
2009
Springer
14 years 2 months ago
2009
Springer
As the World Wide Web is growing rapidly, it is getting increasingly challenging to gather representative information about it. Instead of crawling the web exhaustively one has to...
WEBDB
2007
Springer
14 years 1 months ago
2007
Springer
Due to resource constraints, search engines usually have difficulties keeping the local database completely synchronized with the Web. To detect as many changes as possible, the ...