Sciweavers

4272 search results - page 14 / 855
» A Case for Automatic System Evaluation
Sort
View
CICLING
2005
Springer
13 years 9 months ago
Evaluating Evaluation Methods for Generation in the Presence of Variation
Recent years have seen increasing interest in automatic metrics for the evaluation of generation systems. When a system can generate syntactic variation, automatic evaluation becom...
Amanda Stent, Matthew Marge, Mohit Singhai
LREC
2008
99views Education» more  LREC 2008»
13 years 9 months ago
Evaluating and Extending the Coverage of HPSG Grammars: A Case Study for German
In this work, we examine and attempt to extend the coverage of a German HPSG grammar. We use the grammar to parse a corpus of newspaper text and evaluate the proportion of sentenc...
Jeremy Nicholson, Valia Kordoni, Yi Zhang 0003, Ti...
ICSE
2004
IEEE-ACM
14 years 7 months ago
Automated Generation of Test Programs from Closed Specifications of Classes and Test Cases
Most research on automated specification-based software testing has focused on the automated generation of test cases. Before a software system can be tested, it must be set up ac...
Wee Kheng Leow, Siau-Cheng Khoo, Yi Sun
COLING
2002
13 years 7 months ago
Automatic Linguistic Analysis for Language Teachers: The Case of Zeros
This paper presents the Natural Language Processing-based linguistic analysis tool that we have developed for Japanese as a Second Language teachers. This program, Zero Detector (...
Mitsuko Yamura-Takei, Miho Fujiwara, Makoto Yoshie...
IPM
2007
99views more  IPM 2007»
13 years 7 months ago
Older versions of the ROUGEeval summarization evaluation system were easier to fool
We show some limitations of the ROUGE evaluation method for automatic summarization. We present a method for automatic summarization based on a Markov model of the source text. By...
Jonas Sjöbergh