Sciweavers

2008 search results - page 20 / 402
» MUC-4 evaluation metrics
Sort
View
ACL
2012
11 years 11 months ago
Joint Evaluation of Morphological Segmentation and Syntactic Parsing
We present novel metrics for parse evaluation in joint segmentation and parsing scenarios where the gold sequence of terminals is not known in advance. The protocol uses distance-...
Reut Tsarfaty, Joakim Nivre, Evelina Andersson
METRICS
1997
IEEE
14 years 25 days ago
Evaluating the Interrater Agreement of Process Capability Ratings
Pierfrancesco Fusaro, Khaled El Emam, Bob Smith
ICMCS
2005
IEEE
178views Multimedia» more  ICMCS 2005»
14 years 2 months ago
On the Earth Mover's Distance as a histogram similarity metric for image retrieval
In this paper, the performance of the Earth Mover’s Distance (EMD) vs χ2 distance as histogram similarity metrics for image retrieval is evaluated experimentally. Ground truth ...
Zhenghua Yu, Gunawan Herman
LREC
2008
110views Education» more  LREC 2008»
13 years 10 months ago
Evaluating Evaluation Metrics for Ontology-Based Applications: Infinite Reflection
In this paper, we discuss methods of measuring the performance of ontology-based information extraction systems. We focus particularly on the Balanced Distance Metric (BDM), a new...
Diana Maynard, Wim Peters, Yaoyong Li
LREC
2008
111views Education» more  LREC 2008»
13 years 10 months ago
Sensitivity of Automated MT Evaluation Metrics on Higher Quality MT Output: BLEU vs Task-Based Evaluation Methods
We report the results of an experiment to assess the ability of automated MT evaluation metrics to remain sensitive to variations in MT quality as the average quality of the compa...
Bogdan Babych, Anthony Hartley