Extracting information about emotions in films

We present a method being developed to extract information about characters’ emotions in films. It is suggested that this information can help describe higher levels of multimedia semantics relating to narrative structures. Our method extracts information from audio description that is provided for the visually-impaired with an increasing number of films. The method is based on a cognitive theory of emotions that links a character’s emotional states to the events in their environment. In this paper the method is described along with some preliminary evaluation and discussions about the kinds of novel video retrieval and browsing applications it may support. Categories and Subject Descriptors H.3.1 [Information Storage and Retrieval]: Content analysis and indexing H.5.1 [Information Interfaces and Presentation]: Multimedia information systems Keywords Semantic video content, video retrieval, video browsing, narrative, film, audio description, emotions.

• Type: Conference
• Year: 2003
• Where: MM
• Authors: Andrew Salway, Mike Graham
• Keywords: Audio Description, Method Extracts Information, MM 2003, Video Retrieval