A Study of Adaptive Relevance Feedback - UIUC TREC 2008 Relevance Feedback Experiments

In this paper, we report our experiments in the TREC 2008 Relevance Feedback Track. Our main goal is to study a novel problem in feedback, i.e., optimization of the balance of the query and feedback information. Intuitively, if we over-trust the feedback information, we may be biased to favor a particular subset of relevant documents, but undertrusting it would not take advantage of feedback. In the current feedback methods, the balance is usually controlled by some parameter, which is often set to a fixed value across all the queries and collections. However, due to the difference in queries and feedback documents, this balance parameter should be optimized for each query and each set of feedback documents. To address this problem, we present a learning approach to adaptively predict the balance coefficient (i.e., feedback coefficient). First, three heuristics are proposed to characterize the relationships between feedback coefficient and other measures, including discrimination of q...

• Type: Conference
• Year: 2008
• Where: TREC
• Authors: Yuanhua Lv, ChengXiang Zhai
• Keywords: Feedback, Feedback Documents, Information Technology, Relevance Feedback, TREC 2008