Sciweavers

ICASSP
2010
IEEE

Evaluation of semantic role labeling and dependency parsing of automatic speech recognition output

13 years 11 months ago
Evaluation of semantic role labeling and dependency parsing of automatic speech recognition output
Semantic role labeling (SRL) is an important module of spoken language understanding systems. This work extends the standard evaluation metrics for joint dependency parsing and SRL of text in order to be able to handle speech recognition output with word errors and sentence segmentation errors. We propose metrics based on word alignments and bags of relations, and compare their results on the output of several SRL systems on broadcast news and conversations of the OntoNotes corpus. We evaluate and analyze the relation between the performance of the subtasks that lead to SRL, including ASR, part-of-speech tagging or sentence segmentation. The tools are made available to the community.
Benoît Favre, Bernd Bohnet, Dilek Hakkani-T&
Added 06 Dec 2010
Updated 06 Dec 2010
Type Conference
Year 2010
Where ICASSP
Authors Benoît Favre, Bernd Bohnet, Dilek Hakkani-Tür
Comments (0)