Commonly used coreference resolution evaluation metrics can only be applied to key mentions, i.e. already annotated mentions. We here propose two variants of the B3 and CEAF coref...
The GIVE Challenge is a recent shared task in which NLG systems are evaluated over the Internet. In this paper, we validate this novel NLG evaluation methodology by comparing the ...
Alexander Koller, Kristina Striegnitz, Donna Byron...
A variety of software-based systems are being used as training media. There is not, however, an accepted approach to evaluating the usability of these systems. Traditional usabilit...
Clint A. Bowers, Janis A. Cannon-Bowers, Talib S. ...
This paper describes the system submitted by Loquendo and Politecnico di Torino (LPT) for the 2009 NIST Language Recognition Evaluation. The system is a combination of classifiers...
To help developing a localization oriented EBMT system, an automatic machine translation evaluation method is implemented which adopts edit distance, cosine correlation and Dice c...
Jianmin Yao, Ming Zhou, Tiejun Zhao, Hao Yu, Sheng...