Production in a Multimodal Corpus: how Speakers Communicate Complex Actions

We describe a new multimodal corpus currently under development. The corpus consists of videos of task-oriented dialogues that are annotated for speaker's verbal requests and domain action executions. This resource provides data for new research on language production and comprehension. The corpus can be used to study speakers' decisions as to how to structure their utterances given the complexity of the message they are trying to convey.

• Type: Conference
• Year: 2008
• Where: LREC
• Authors: Carlos Gómez Gallo, T. Florian Jaeger, James F. Allen, Mary D. Swift
• Keywords: Domain Action Executions, Education, LREC 2008, Speaker's Verbal Requests, Task-oriented Dialogues