Fast query expansion using approximations of relevance models

Pseudo-relevance feedback (PRF) improves search quality by expanding the query using terms from high-ranking documents from an initial retrieval. Although PRF can often result in large gains in effectiveness, running two queries is time consuming, limiting its applicability. We describe a PRF method that uses corpus pre-processing to achieve query-time speeds that are near those of the original queries. Specifically, Relevance Modeling, a language modeling based PRF method, can be recast to benefit substantially from finding pairwise document relationships in advance. Using the resulting Fast Relevance Model (fastRM), we substantially reduce the online retrieval time and still benefit from expansion. We further explore methods for reducing the preprocessing time and storage requirements of the approach, allowing us to achieve up to a 10% increase in MAP over unexpanded retrieval, while only requiring 1% of the time of standard expansion. Categories and Subject Descriptors: H.3.3 ...

• Type: Journal
• Year: 2010
• Where: CIKM
• Authors: Marc-Allen Cartright, James Allan, Victor Lavrenko, Andrew McGregor
• Keywords: CIKM 2010, Information Technology, Initial Retrieval, Online Retrieval Time, PRF Method