CoBWeb - A Crawler for the Brazilian Web

One of the key components of current Web search engines is the document collector. This paper describes CoBWeb, an automatic document collector, whose architecture is distributed and highly scalable. CoBWeb aims at collecting large amounts of documents per time period, while observing operational and ethical limits in the crawling process. CoBWeb is part of the SIAM (Information Systems in Mobile Computing Environments) search engine which is being implemented to support the Brazilian Web. Thus, several results related to the Brazilian Web are presented.

• Type: Conference
• Year: 1999
• Where: SPIRE
• Authors: Altigran Soares da Silva, Eveline A. Veloso, Paulo Braz Golgher, Berthier A. Ribeiro-Neto, Alberto H. F. Laender, Nivio Ziviani
• Keywords: Document Collector, Information Management, Paper Describes Cobweb, Search Engine, SPIRE 1999