Role-based teamwork activity recognition in observations of embodied agent actions

Recognizing team actions in the behavior of embodied agents has many practical applications and had seen significant progress in recent years. One approach with proven results is based on HMMbased recognition of spatio-temporal patterns in the behavior of the agents. While it had been shown to work on real-world datasets, this approach was found to be brittle. In this paper we present two contributions which together can significantly increase the robustness of teamwork activity recognition. First we introduce a technique to reduce high dimensional continuous input data to a set of discrete features, which capture the essential components of the team actions. Second, we prefix the actual team action recognition with a role recognition module, which allows us to present the recognizer with arbitrarily shuffled input, and still obtain high recognition rates. We validate the improved accuracy and robustness of the team action recognizer on datasets derived from captured real world data. ...

• Type: Conference
• Year: 2008
• Where: ATAL
• Authors: Linus J. Luotsinen, Ladislau Bölöni
• Keywords: ATAL 2008, Embodied Agents, Intelligent Agents, Team Action, Teamwork Activity Recognition