Object-based MPEG-2 video indexing and retrieval in a collaborative environment

In this paper, an object-based video retrieval methodology for search in large, heterogeneous video collections is presented. The proposed approach employs a real-time, compressed-domain, unsupervised algorithm for the segmentation of image sequences to spatiotemporal objects. For the resulting objects, MPEG-7 compliant low-level descriptors describing their color, shape, position and motion characteristics are extracted. These are automatically associated using a fuzzy C-means algorithm with appropriate intermediatelevel descriptors, which are part of a simple vocabulary termed object ontology. Combined with a relevance feedback mechanism, this scheme allows the qualitative definition of the high-level concepts the user queries for (semantic objects, each represented by a keyword) and relations between them, facilitating the retrieval of relevant video segments. Furthermore, it allows the collaborative construction of a knowledge base by accumulating the information contributed to the...

• Type: Journal
• Year: 2006
• Where: MTA
• Authors: Vasileios Mezaris, Ioannis Kompatsiaris, Michael G. Strintzis
• Keywords: MTA 2006, Object-based Video, Object-based Video Retrieval, Video