Lyrics-Based Audio Retrieval and Multimodal Navigation in Music Collections

Modern digital music libraries contain textual, visual, and audio data describing music on various semantic levels. Exploiting the availability of different semantically interrelated representations for a piece of music, this paper presents a query-by-lyrics retrieval system that facilitates multimodal navigation in CD audio collections. In particular, we introduce an automated method to time align given lyrics to an audio recording of the underlying song using a combination of synchronization algorithms. Furthermore, we describe a lyrics search engine and show how the lyrics-audio alignments can be used to directly navigate from the list of query results to the corresponding matching positions within the audio recordings. Finally, we present a user interface for lyrics-based queries and playback of the query results that extends the functionality of our SyncPlayer framework for content-based music and audio navigation.

• Type: Conference
• Year: 2007
• Where: ERCIMDL
• Authors: Meinard Müller, Frank Kurth, David Damm, Christian Fremerey, Michael Clausen
• Keywords: Audio Recordings, CD Audio Collections, ERCIMDL 2007, Modern Digital Music