Modeling the Score Distributions of Relevant and Non-relevant Documents

Empirical modeling of the score distributions associated with retrieved documents is an essential task for many retrieval applications. In this work, we propose modeling the relevant documents’ scores by a mixture of Gaussians and modeling the non-relevant scores by a Gamma distribution. Applying variational inference we automatically trade-off the goodness-of-fit with the complexity of the model. We test our model on traditional retrieval functions and actual search engines submitted to TREC. We demonstrate the utility of our model in inferring precisionrecall curves. In all experiments our model outperforms the dominant exponential-Gaussian model.

• Type: Conference
• Year: 2009
• Where: ICTIR
• Authors: Evangelos Kanoulas, Virgiliu Pavlu, Keshi Dai, Javed A. Aslam
• Keywords: Dominant Exponential-Gaussian Model, Empirical Modeling, ICTIR 2009, Information Retrieval, Traditional Retrieval Functions