Compaction Techniques for Nextword Indexes

Most queries to text search engines are ranked or Boolean. Phrase querying is a powerful technique for refining searches, but is expensive to implement on conventional indexes. In other work, a nextword index has been proposed as a structure specifically designed for phrase queries. Nextword indexes are, however, relatively large. In this paper we introduce new compaction techniques for nextword indexes. In contrast to most index compression schemes, these techniques are lossy, yet as we show allow full resolution of phrase queries without false match checking. We show experimentally that our novel techniques lead to significant savings in index size.

• Type: Conference
• Year: 2001
• Where: SPIRE
• Authors: Dirk Bahle, Hugh E. Williams, Justin Zobel
• Keywords: Conventional Indexes, Information Management, Most Queries, Phrase Queries, SPIRE 2001