102 search results - page 15 / 21 » Agent-Based Approach for Web Crawling |
WIDM
2006
ACM
14 years 2 months ago
2006
ACM
In this paper, we identify and analyze structural properties which reflect the functionality of a Web site. These structural properties consider the size, the organization, the co...
WSDM
2010
ACM
14 years 2 months ago
2010
ACM
Presence of duplicate documents in the World Wide Web adversely affects crawling, indexing and relevance, which are the core building blocks of web search. In this paper, we pres...
WWW
2008
ACM
14 years 8 months ago
2008
ACM
It is crucial for a web crawler to distinguish between ephemeral and persistent content. Ephemeral content (e.g., quote of the day) is usually not worth crawling, because by the t...
WWW
2005
ACM
14 years 8 months ago
2005
ACM
We present a system that gathers and analyzes online discussion as it relates to consumer products. Weblogs and online message boards provide forums that record the voice of the p...
WWW
2007
ACM
14 years 8 months ago
2007
ACM
Current web search engines focus on searching only the most recent snapshot of the web. In some cases, however, it would be desirable to search over collections that include many ...