Sciweavers

942 search results - page 6 / 189
» Comparing Automatic and Human Evaluation of NLG Systems
Sort
View
ACL
2008
13 years 9 months ago
Assessing Dialog System User Simulation Evaluation Measures Using Human Judges
Previous studies evaluate simulated dialog corpora using evaluation measures which can be automatically extracted from the dialog systems' logs. However, the validity of thes...
Hua Ai, Diane J. Litman
ICASSP
2011
IEEE
12 years 11 months ago
Including human expertise in speaker recognition systems: report on a pilot evaluation
The 2010 NIST Speaker Recognition Evaluation (SRE10) included a test of Human Assisted Speaker Recognition (HASR) in which systems based in whole or in part on human expertise wer...
Craig S. Greenberg, Alvin F. Martin, George R. Dod...
IWPC
2000
IEEE
14 years 12 days ago
A Framework for Experimental Evaluation of Clustering Techniques
Experimental evaluation of clustering techniques for component recovery is necessary in order to analyze their strengths and weaknesses in comparison to other techniques. For comp...
Rainer Koschke, Thomas Eisenbarth
COLING
2010
13 years 3 months ago
Automatic analysis of semantic similarity in comparable text through syntactic tree matching
We propose to analyse semantic similarity in comparable text by matching syntactic trees and labeling the alignments according to one of five semantic similarity relations. We pre...
Erwin Marsi, Emiel Krahmer
EMNLP
2009
13 years 5 months ago
Automatically Evaluating Content Selection in Summarization without Human Models
We present a fully automatic method for content selection evaluation in summarization that does not require the creation of human model summaries. Our work capitalizes on the assu...
Annie Louis, Ani Nenkova