Mixture model based contextual image retrieval

Traditional image retrieval techniques search for images without considering the query context. When they are applied to applications like annotating text with images, the results might not be satisfactory because the meaning of a word/phrase varies depending on the context. In this paper, we propose an alternative method to retrieve images based not only on the query but also on the query context. We exploit the text surrounding a query in a document and the disambiguated sense of the query as the query context. We also propose a mixture model to retrieve the context dependent images. Experimental results show that significantly better retrieval performance can be achieved when query context is taken into account. Categories and Subject Descriptors H.3.3 [Information Storage and Retrieval]: Information Search and Retrieval General Terms Algorithms Keywords Contextual Image Retrieval, Text Annotation

• Type: Conference
• Year: 2010
• Where: CIVR
• Authors: Xing Xing, Yi Zhang, Bo Gong
• Keywords: CIVR 2010, Image Analysis, Image Retrieval, Image Retrieval Techniques, Query Context