A methodology is presented for component-based machine translation (MT) evaluation through causal error analysis to complement existing global evaluation methods. Thismethodology is particularly appropriate for knowledge-based machine translation (KBMT) systems. After a discussion of MT evaluation criteria and the particular evaluation metrics proposed for KBMT, we apply this methodology to a large-scale application of the KANT machine translation system, and present some sample results.
Eric Nyberg, Teruko Mitamura, Jaime G. Carbonell