Approaches to Collection Selection and Results Merging for Distributed Information Retrieval

We have investigated two major issues in Distributed Information Retrieval (DIR), namely: collection selection and search results merging. While most published works on these two issues are based on pre-stored metadata, the approaches described in this paper involve extracting the required information at the time the query is processed. In order to predict the relevance of collections to a given query, we analyse a limited number of full documents (e.g., the top five documents) retrieved from each collection and then consider term proximity within them. On the other hand, our merging technique is rather simple since input only requires document scores and lengths of results lists. Our experiments evaluate the retrieval effectiveness of these approaches and compare them with centralised indexing and various other DIR techniques (e.g., CORI [2][3][23]). We conducted our experiments using two testbeds: one containing news articles extracted from four different sources (2 GB) and another ...

• Type: Conference
• Year: 2001
• Where: CIKM
• Authors: Yves Rasolofo, Faiza Abbaci, Jacques Savoy
• Keywords: CIKM 2001, Collection Selection, Information Management, Information Retrieval, Retrieval Effectiveness