The challenge problem for automated detection of 101 semantic concepts in multimedia

We introduce the challenge problem for generic video indexing to gain insight in intermediate steps that affect performance of multimedia analysis methods, while at the same time fostering repeatability of experiments. To arrive at a challenge problem, we provide a general scheme for the systematic examination of automated concept detection methods, by decomposing the generic video indexing problem into 2 unimodal analysis experiments, 2 multimodal analysis experiments, and 1 combined analysis experiment. For each experiment, we evaluate generic video indexing performance on 85 hours of international broadcast news data, from the TRECVID 2005/2006 benchmark, using a lexicon of 101 semantic concepts. By establishing a minimum performance on each experiment, the challenge problem allows for component-based optimization of the generic indexing issue, while simultaneously offering other researchers a reference for comparison during indexing methodology development. To stimulate further ...

• Type: Conference
• Year: 2006
• Where: MM
• Authors: Cees Snoek, Marcel Worring, Jan van Gemert, Jan-Mark Geusebroek, Arnold W. M. Smeulders
• Keywords: Challenge Problem, Generic Video Indexing, MM 2006, Video Indexing Performance