Sciweavers

57 search results - page 7 / 12
» How to Test the Performance of Speech Verifiers and Statisti...
Sort
View
CIKM
2006
Springer
13 years 11 months ago
Investigating the exhaustivity dimension in content-oriented XML element retrieval evaluation
INEX, the evaluation initiative for content-oriented XML retrieval, has since its establishment defined the relevance of an element according to two graded dimensions, exhaustivit...
Paul Ogilvie, Mounia Lalmas
PET
2012
Springer
11 years 10 months ago
Understanding Statistical Disclosure: A Least Squares Approach
It is widely accepted that Disclosure Attacks are effective against high-latency anonymous communication systems. A number of Disclosure Attack variants can be found in the litera...
Fernando Pérez-González, Carmela Tro...
ACL
1998
13 years 8 months ago
Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent
While the notion of a cooperative response has been the focus of considerable research in natural language dialogue systems, there has been little empirical work demonstrating how...
Diane J. Litman, Shimei Pan, Marilyn A. Walker
JETAI
2010
56views more  JETAI 2010»
13 years 5 months ago
Warning: statistical benchmarking is addictive. Kicking the habit in machine learning
Algorithm performance evaluation is so entrenched in the Machine Learning community that one could call it an addiction. Like most addictions, it is harmful and very difficult to ...
Chris Drummond, Nathalie Japkowicz
NAACL
2010
13 years 5 months ago
The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
Translation systems are generally trained to optimize BLEU, but many alternative metrics are available. We explore how optimizing toward various automatic evaluation metrics (BLEU...
Daniel Cer, Christopher D. Manning, Daniel Jurafsk...