Sciweavers

ACL
2009
13 years 10 months ago
Correlating Human and Automatic Evaluation of a German Surface Realiser
We examine correlations between native speaker judgements on automatically generated German text against automatic evaluation metrics. We look at a number of metrics from the MT a...
Aoife Cahill
EMNLP
2010
13 years 10 months ago
Further Meta-Evaluation of Broad-Coverage Surface Realization
We present the first evaluation of the utility of automatic evaluation metrics on surface realizations of Penn Treebank data. Using outputs of the OpenCCG and XLE realizers, along...
Dominic Espinosa, Rajakrishnan Rajkumar, Michael W...
LREC
2010
148views Education» more  LREC 2010»
14 years 1 months ago
Mining the Correlation between Human and Automatic Evaluation at Sentence Level
Automatic evaluation metrics are fast and cost-effective measurements of the quality of a Machine Translation (MT) system. However, as humans are the end-user of MT output, human ...
Yanli Sun
ACL
2007
14 years 1 months ago
Regression for Sentence-Level MT Evaluation with Pseudo References
Many automatic evaluation metrics for machine translation (MT) rely on making comparisons to human translations, a resource that may not always be available. We present a method f...
Joshua Albrecht, Rebecca Hwa
ACL
2007
14 years 1 months ago
A Re-examination of Machine Learning Approaches for Sentence-Level MT Evaluation
Recent studies suggest that machine learning can be applied to develop good automatic evaluation metrics for machine translated sentences. This paper further analyzes aspects of l...
Joshua Albrecht, Rebecca Hwa