Sciweavers

5489 search results - page 109 / 1098
» Evaluating evaluation measure stability
Sort
View
GECCO
2003
Springer
114views Optimization» more  GECCO 2003»
15 years 11 months ago
Learning the Ideal Evaluation Function
Abstract. Designing an adequate fitness function requiressubstantial knowledge of a problem and of features that indicate progress towards a solution. Coevolution takes the human ...
Edwin D. de Jong, Jordan B. Pollack
SIGIR
2003
ACM
15 years 11 months ago
Using manually-built web directories for automatic evaluation of known-item retrieval
Information retrieval system evaluation is complicated by the need for manually assessed relevance judgments. Large manually-built directories on the web open the door to new eval...
Steven M. Beitzel, Eric C. Jensen, Abdur Chowdhury...
SIGIR
2003
ACM
15 years 11 months ago
The TREC-like evaluation of music IR systems
This poster reports upon the ongoing efforts being made to establish TREC-like and other comprehensive evaluation paradigms within the Music IR (MIR) and Music Digital Library (MD...
J. Stephen Downie
CLEF
2006
Springer
15 years 10 months ago
Scientific Data of an Evaluation Campaign: Do We Properly Deal with Them?
Abstract. This paper examines the current way of keeping the data produced during the evaluation campaigns and highlights some shortenings of it. As a consequence, we propose a new...
Maristella Agosti, Giorgio Maria Di Nunzio, Nicola...
SIGIR
2005
ACM
15 years 11 months ago
On evaluation of adaptive topic tracking systems
Summative evaluation methods for supervised adaptive topic tracking systems convolve the effect of system decisions on present utility with the effect on future utility. This pa...
Tamer Elsayed, Douglas W. Oard