For the first interactive Cross-Language Evaluation Forum, the Maryland team focused on comparison of term-for-term gloss translation with full machine translation for the documen...
In the ever increasing world of distributed systems, different middleware implementations can be compared qualitatively or quantitatively. Existing evaluation techniques are often...
Assessors frequently disagree on the topical relevance of documents. How much of this disagreement is due to ambiguity in assessment instructions? We have two assessors assess TRE...
Abstract. In spite of the wide use of the Internet, it is difficult to develop desirable web documents evaluation that reflects users’ needs. Many automatic ranking systems have ...
We are developing evaluation tools that help sustainable HCI researchers to contribute to the overall project of achieving sustainability. In this paper we argue for broadening su...