Risk-Aware Information Retrieval

Probabilistic retrieval models usually rank documents based on a scalar quantity. However, such models lack any estimate for the uncertainty associated with a document’s rank. Further, such models seldom have an explicit utility (or cost) that is optimized when ranking documents. To address these issues, we take a Bayesian perspective that explicitly considers the uncertainty associated with the estimation of the probability of relevance, and propose an asymmetric cost function for document ranking. Our cost function has the advantage of adjusting the risk in document retrieval via a single parameter for any probabilistic retrieval model. We use the logit model to transform the document posterior distribution with probability space [0,1] into a normal distribution with variable space (−∞, +∞). We apply our risk adjustment approach to a language modelling framework for risk adjustable document ranking. Our experimental results show that our risk-aware model can significantly im...

• Type: Conference
• Year: 2009
• Where: ECIR
• Authors: Jianhan Zhu, Jun Wang, Michael J. Taylor, Ingemar J. Cox
• Keywords: Adjustable Document Ranking, Computer Science, Dirichlet Smoothing Approach, ECIR 2009, Probabilistic Retrieval Models