Neighborhood Coherence and Edge Based Approaches to Film Scene Extraction

In order to enable high-level semantics-based video annotation and interpretation, we tackle the problem of automatic decomposition of motion pictures into meaningful story units, namely scenes. Since a scene is a complicated and subjective concept, we first propose guidelines from film production to determine when a scene change occurs in film. We examine different rules and conventions followed as part of Film Grammar to guide and shape our algorithmic solution for determining a scene boundary. Two different techniques are proposed as new solutions in this paper. Our experimental results on 10 full-length movies show that our technique based on shot sequence coherence performs well and reasonably better than the color edges-based approach.

• Type: Conference
• Year: 2002
• Where: ICPR
• Authors: Ba Tu Truong, Svetha Venkatesh, Chitra Dorai
• Keywords: ICPR 2002, Meaningful Story Units, Semantics-based Video Annotation, Shot Sequence Coherence