Measuring concept relatedness using language models

Over the years, the notion of concept relatedness has attracted considerable attention. A variety of approaches, based on ontology structure, information content, association, or context have been proposed to indicate the res of abstract ideas. We propose a method based on the cross entropy reduction between language models of concepts which are estimated based on document-concept assignments. The approach shows improved or competitive results compared to state-of-the-art methods on two test sets in the biomedical domain. Categories and Subject Descriptors H.3.1 [Information Storage and Retrieval]: Content and Indexing--Abstracting methods General Terms Algorithms, Theory, Experimentation, Measurement Keywords Language Models, Semantic Relatedness

• Type: Journal
• Year: 2008
• Where: SIGIR
• Authors: Dolf Trieschnigg, Edgar Meij, Maarten de Rijke, Wessel Kraaij
• Keywords: Concept Relatedness, Cross Entropy Reduction, Information Technology, Language Models, SIGIR 2008