Evaluation Metrics for the Lexical Substitution Task

We identify some problems of the evaluation metrics used for the English Lexical Substitution Task of SemEval-2007, and propose alternative metrics that avoid these problems, which we hope will better guide the future development of lexical substitution systems.

• Type: Journal
• Year: 2010
• Where: NAACL
• Authors: Sanaz Jabbari, Mark Hepple, Louise Guthrie
• Keywords: Computational Linguistics, Lexical Substitution, Lexical Substitution Systems, Lexical Substitution Task, NAACL 2010