Almost all system and application design for multimedia systems is based around a single user working in isolation to perform some task yet much of the work for which we use comput...
Alan F. Smeaton, Hyowon Lee, Colum Foley, Sin&eacu...
This paper presents an analysis of user studies from a review of papers describing new visualisation applications and uses these to highlight various issues related to the evaluat...
: We analyse 18 evaluation methods for learning algorithms and classifiers, and show how to categorise these methods with the help of an evaluation method taxonomy based on several...
This paper analyses some general issues about human language technology evaluation, focusing on economic aspects. It first provides a scientific rationale for the need to organize...
Evaluating the output of NLG systems is notoriously difficult, and performing assessments of text quality even more so. A range of automated and subject-based approaches to the ev...