Toward a Task-based Gold Standard for Evaluation of NP Chunks and Technical Terms

We propose a gold standard for evaluating two types of information extraction output -- noun phrase (NP) chunks (Abney 1991; Ramshaw and Marcus 1995) and technical terms (Justeson and Katz 1995; Daille 2000; Jacquemin 2002). The gold standard is built around the notion that since different semantic and syntactic variants of terms are arguably correct, a fully satisfactory assessment of the quality of the output must include task-based evaluation. We conducted an experi

• Type: Conference
• Year: 2003
• Where: NAACL
• Authors: Nina Wacholder, Peng Song
• Keywords: Gold Standard, Information Extraction Output, NAACL 2003, NAACL 2007, Noun Phrase