A Scalable Distributed Search Engine for Fresh Information Retrieval

We have developed a distributed search engine, Cooperative Search Engine (CSE) to retrieve fresh information. In CSE, a local search engine located in each web server makes an index of local pages. And, a Meta search server integrates these local search engines to realize a global search engine. In such a way, the communication delay occurs at retrieval. So, we have developed several speedup techniques in order to realize real time retrieval. In addition, the meta server is a single point of failure in CSE. So, we introduce redundancy of the meta search server increase availability of CSE. In this paper, we describe scalability and reliability of CSE and their evaluations. KEYWORDS Cooperative Search Engine, WWW, Distributed Search Engine.

• Type: Conference
• Year: 2003
• Where: IADIS
• Authors: Nobuyoshi Sato, Minoru Uehara, Yoshifumi Sakai
• Keywords: Cooperative Search Engine, IADIS 2003, IADIS 2008, Local Search Engines, Search Engine