Integrating word relationships into language models

In this paper, we propose a novel dependency language modeling approach for information retrieval. The approach extends the existing language modeling approach by relaxing the independence assumption. Our goal is to build a language model in which various word relationships can be integrated. In this work, we integrate two types of relationship extracted from WordNet and co-occurrence relationships respectively. The integrated model has been tested on several TREC collections. The results show that our model achieves substantial and significant improvements with respect to the models without these relationships. These results clearly show the benefit of integrating word relationships into language models for IR. Categories and Subject Descriptors H.3.3 [Information Search and Retrieval]: Retrieval Models – dependency language model, parameter setting, thesauri General Terms Algorithms, Theory, Experimentation, Performance Keywords Information Retrieval, Language Modeling, dependency...

• Type: Conference
• Year: 2005
• Where: SIGIR
• Authors: Guihong Cao, Jian-Yun Nie, Jing Bai
• Keywords: Dependency Language, Language Modeling Approach, SIGIR 2005, Word Relationships