Semantic Evaluation for Spoken-Language Systems

Development has begun on a semantic evaluation (SemEval) methodology and infrastructure for the ARPA Spoken Language Program. SemEval is an attempt to define a task-independent technology-based evaluation for languageunderstanding systems consisting of three parts: word-sense identification, predicate-argument structure determination, and identification of coreference relations. An initial spokenlanguage SemEval on ATIS data is planned for November/December 1994, concurrent with the next ATIS CAS (database answer) evaluation.

• Type: Conference
• Year: 1994
• Where: NAACL
• Authors: Robert C. Moore
• Keywords: ARPA Spoken Language, Initial Spokenlanguage Semeval, NAACL 1994, NAACL 2007, Task-independent Technology-based Evaluation