Sciweavers

37 search results - page 4 / 8
» Assessing Dialog System User Simulation Evaluation Measures ...
Sort
View
SIGIR
2012
ACM
11 years 10 months ago
Time-based calibration of effectiveness measures
Many current effectiveness measures incorporate simplifying assumptions about user behavior. These assumptions prevent the measures from reflecting aspects of the search process...
Mark D. Smucker, Charles L. A. Clarke
SIGIR
2003
ACM
14 years 25 days ago
Automatic ranking of retrieval systems in imperfect environments
The empirical investigation of the effectiveness of information retrieval (IR) systems requires a test collection, a set of query topics, and a set of relevance judgments made by ...
Rabia Nuray, Fazli Can
SIGIR
2003
ACM
14 years 25 days ago
Searchers' criteria For assessing web pages
We investigate the criteria used by online searchers when assessing the relevance of web pages to information-seeking tasks. Twenty four searchers were given three tasks each, and...
Anastasios Tombros, Ian Ruthven, Joemon M. Jose
IJCAI
1997
13 years 9 months ago
An Achievement Test for Knowledge-Based Systems: QUEM
This paper describes QUEM, a method for assessing the skill level of a knowledge-based system based on the quality of the solutions it produces. QUEM is demonstrated by using it t...
Caroline C. Hayes, Michael I. Parzen
AVI
2008
13 years 10 months ago
An empirical evaluation of interactive visualizations for preferential choice
Many critical decisions for individuals and organizations are often framed as preferential choices: the process of selecting the best option out of a set of alternatives. This pap...
Jeanette Bautista, Giuseppe Carenini