Sciweavers

4272 search results - page 25 / 855
» A Case for Automatic System Evaluation
Sort
View
COLING
2008
13 years 9 months ago
The Impact of Reference Quality on Automatic MT Evaluation
Language resource quality is crucial in NLP. Many of the resources used are derived from data created by human beings out of an NLP context, especially regarding MT and reference ...
Olivier Hamon, Djamel Mostefa
FDL
2005
IEEE
14 years 1 months ago
Linearly graded behavioural analogue performance models
A concept of linearly graded statistical models for analogue performance evaluation is proposed and a suitable technique for automatic generation of analogue performance models us...
Xianqiang Ren, Tom J. Kazmierski
PCI
2009
Springer
14 years 5 days ago
Adaptive Evaluation of Portal Quality: An eGovernment Case
— In this paper we describe a knowledge-based approach that enables the subjective evaluation of portal and e-service quality by users in an adaptive manner. The model for adapti...
Babis Magoutas, Gregoris Mentzas
ACL
2001
13 years 9 months ago
A Machine Learning Approach to the Automatic Evaluation of Machine Translation
We present a machine learning approach to evaluating the wellformedness of output of a machine translation system, using classifiers that learn to distinguish human reference tran...
Simon Corston-Oliver, Michael Gamon, Chris Brocket...
ACL
2012
11 years 10 months ago
Assessing the Effect of Inconsistent Assessors on Summarization Evaluation
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...