Genre-specific semantic video indexing

In many applications, we find large video collections from different genres where the user is often only interested in one or two specific video genres. So, when users are querying the system with a specific semantic concept, they are likely aiming a genre specific instantiation of this concept. Thus, a question is how to detect genre specific semantic concepts such as Child in HomeVideo, or FrontalFace in Porn, in an efficient and accurate way. We propose a framework to do such genre-specific context detection. Genre specific models are trained based on a training set with data labelled at video level for genres and at shot level for semantic concepts. In the classification stage, video genre classification is applied first to reduce the entire data set to a relatively small subset. Then, the genre-specific concept models are applied to this subset only. Experiments have been conducted on a small, but realistic 28-hour video data set including YouTube videos, porn videos, TV programs...

• Type: Journal
• Year: 2010
• Where: CIVR
• Authors: Jun Wu, Marcel Worring
• Keywords: CIVR 2010, Image Analysis, Semantic Concepts, Specific Semantic Concepts, Video Genres