Revisiting Globally Sorted Indexes for Efficient Document Retrieval

There has been a large amount of research on efficient document retrieval in both IR and web search areas. One important technique to improve retrieval efficiency is early termination, which speeds up query processing by avoiding scanning the entire inverted lists. Most early termination techniques first build new inverted indexes by sorting the inverted lists in the order of either the term-dependent information, e.g., term frequencies or term IR scores, or the term-independent information, e.g., static rank of the document; and then apply appropriate retrieval strategies on the resulting indexes. Although the methods based only on the static rank have been shown to be ineffective for the early termination, there are still many advantages of using the methods based on term-independent information. In this paper, we propose new techniques to organize inverted indexes based on the termindependent information beyond static rank and study the new retrieval strategies on the resulting ind...

• Type: Conference
• Year: 2010
• Where: WSDM
• Authors: Fan Zhang, Shuming Shi, Hao Yan, Ji-Rong Wen
• Keywords: Appropriate Retrieval Strategies, Data Mining, Early Termination Techniques, Entire Inverted Lists, WSDM 2010