The TREC-like evaluation of music IR systems

This poster reports upon the ongoing efforts being made to establish TREC-like and other comprehensive evaluation paradigms within the Music IR (MIR) and Music Digital Library (MDL) research communities. The proposed research tasks are based upon expert opinion garnered from members of the Information Retrieval (IR), MDL and MIR communities with regard to the construction and implementation of scientifically valid evaluation frameworks. Categories and Subject Descriptors H.3.4 [Information Storage and Retrieval]: Systems and Software – performance evaluation General Terms Measurement, Performance, Human Factors Keywords TREC, Evaluation, Music Information Retrieval

• Type: Conference
• Year: 2003
• Where: SIGIR
• Authors: J. Stephen Downie
• Keywords: Comprehensive Evaluation Paradigms, Information Retrieval, SIGIR 2003, Valid Evaluation Frameworks