On the Suitability of Programming Tasks for Automated Evaluation

Abstract. For many programming tasks we would be glad to have some kind of automatic evaluation process. As an example, most of the programming contests use an automatic evaluation of the contestants' submissions. While this approach is clearly highly efficient, it also has some drawbacks. Often it is the case that the test inputs are not able to "break" all flawed submissions. In this article we show that the situation is not pleasant at all

• Type: Journal
• Year: 2006
• Where: IIE
• Authors: Michal Forisek
• Keywords: Automatic Evaluation, Automatic Evaluation Process, IIE 2006, Programming Tasks