Spatiotemporal Coding in ANVIL

We present a new coding mechanism, spatiotemporal coding, that allows coders to annotate points and regions in the video frame by drawing directly on the screen. Coders can not only attach labels to time intervals in the video but can specify a possibly moving region on the video screen. This opens up the spatial dimension for multi-track video coding and is an essential asset in almost every area of video coding, e.g. gesture coding, facial expression coding, encoding semantics for information retrieval etc. We discuss conceptual variants, design decisions and the relation to the MPEG-7 standard and tools.

• Type: Conference
• Year: 2008
• Where: LREC
• Authors: Michael Kipp
• Keywords: Education, LREC 2008, Multi-track Video Coding, Spatiotemporal Coding, Video Coding