Peer-to-peer information retrieval using self-organizing semantic overlay networks

Content-based full-text search is a challenging problem in Peer-toPeer (P2P) systems. Traditional approaches have either been centralized or use flooding to ensure accuracy of the results returned. In this paper, we present pSearch, a decentralized non-flooding P2P information retrieval system. pSearch distributes document indices through the P2P network based on document semantics generated by Latent Semantic Indexing (LSI). The search cost (in terms of different nodes searched and data transmitted) for a given query is thereby reduced, since the indices of semantically related documents are likely to be co-located in the network. We also describe techniques that help distribute the indices more evenly across the nodes, and further reduce the number of nodes accessed using appropriate index distribution as well as using index samples and recently processed queries to guide the search. Experiments show that pSearch can achieve performance comparable to centralized information retrie...

• Type: Conference
• Year: 2003
• Where: SIGCOMM
• Authors: Chunqiang Tang, Zhichen Xu, Sandhya Dwarkadas
• Keywords: Content-based Full-text Search, Decentralized Non-flooding P2p, Information Retrieval Systems, SIGCOMM 2003