The MediaMill TRECVID 2007 Semantic Video Search Engine

In this paper we describe our TRECVID 2007 experiments. The MediaMill team participated in two tasks: concept detection and search. For concept detection we extract regionbased image features, on grid, keypoint, and segmentation level, which we combine with various supervised learners. In addition, we explore the utility of temporal image features. A late fusion approach of all region-based analysis methods using geometric mean was our most successful run. What is more, using MediaMill Challenge and LSCOM annotations, our visual-only approach generalizes to a set of 572 concept detectors. To handle such a large thesaurus in retrieval, an engine is developed which automatically selects a set of relevant concept detectors based on text matching, ontology querying, and visual concept likelihood. The suggestion engine is evaluated as part of the automatic search task and forms the entry point for our interactive search experiments. For this task we experiment with two browsers for interac...

• Type: Conference
• Year: 2007
• Where: TRECVID
• Authors: Cees G. M. Snoek, I. Everts, Jan van Gemert, Jan-Mark Geusebroek, Bouke Huurnink, Dennis Koelma, M. van Liempt, Ork de Rooij, Koen E. A. van de Sande, Arnold W. M. Smeulders, Jasper R. R. Uijlings, Marcel Worring
• Keywords: Concept Detection, Concept Detectors, Interactive Search, TRECVID 2007, TRECVID 2008