Personal Information Assistants that search on user’s behalf aim to fetch relevant documents on a regular basis. We have developed such assistant system and evaluated it using a...
We present a comprehensive model for quantitative evaluation and comparison of search engines. The model is based on the LSP method for system evaluation. The basic contribution of...
This paper presents PARADISE (PARAdigm for DIalogue System Evaluation), a general framework for evaluating spoken dialogue agents. The framework decouples task requirements from a...
Marilyn A. Walker, Diane J. Litman, Candace A. Kam...
: This paper presents an approach for defining evaluation criteria for reusable software components. We introduce a taxonomy of factors that influence selection, describe each of t...
Jyrki Kontio, Gianluigi Caldiera, Victor R. Basili
A key question facing the parsing community is how to compare parsers which use different grammar formalisms and produce different output. Evaluating a parser on the same resource...