Sciweavers

942 search results - page 5 / 189
» Comparing Automatic and Human Evaluation of NLG Systems
Sort
View
CORR
2000
Springer
107views Education» more  CORR 2000»
13 years 7 months ago
How to Evaluate your Question Answering System Every Day and Still Get Real Work Done
In this paper, we report on Qaviar, an experimental automated evaluation system for question answering applications. The goal of our research was to find an automatically calculat...
Eric Breck, John D. Burger, Lisa Ferro, Lynette Hi...
ACL
2009
13 years 5 months ago
Comparing Objective and Subjective Measures of Usability in a Human-Robot Dialogue System
We present a human-robot dialogue system that enables a robot to work together with a human user to build wooden construction toys. We then describe a study in which na
Mary Ellen Foster, Manuel Giuliani, Alois Knoll
ACL
2012
11 years 10 months ago
Assessing the Effect of Inconsistent Assessors on Summarization Evaluation
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...
MICCAI
2003
Springer
14 years 9 months ago
An Automatic System for Classification of Nuclear Sclerosis from Slit-Lamp Photographs
A robust and automatic system has been developed to detect the visual axis and extract important feature landmarks from slit-lamp photographs, and objectively grade the severity of...
Shaohua Fan, Charles R. Dyer, Larry Hubbard, Barba...
CICLING
2006
Springer
13 years 11 months ago
A Comparative Evaluation of a New Unsupervised Sentence Boundary Detection Approach on Documents in English and Portuguese
Abstract. In this paper, we describe a new unsupervised sentence boundary detection system and present a comparative study evaluating its performance against different systems foun...
Jan Strunk, Carlos Nascimento Silla Jr., Celso A. ...