Spatiotemporal semantic video segmentation

—In this paper, we propose a framework to extend semantic labeling of images to video shot sequences and achieve efficient and semantic-aware spatiotemporal video segmentation. This task faces two major challenges, namely the temporal variations within a video sequence which affect image segmentation and labeling, and the computational cost of region labeling. Guided by these limitations, we design a method where spatiotemporal segmentation and object labeling are coupled to achieve semantic annotation of video shots. An internal graph structure that describes both visual and semantic properties of image and video regions is adopted. The process of spatiotemporal semantic segmentation is subdivided in two stages: Firstly, the video shot is split into small block of frames. Spatiotemporal regions (volumes) are extracted and labeled individually within each block. Then, we iteratively merge consecutive blocks by a matching procedure which considers both semantic and visual properties....

• Type: Conference
• Year: 2008
• Where: MMSP
• Authors: Eric Galmar, Thanos Athanasiadis, Benoit Huet, Yannis S. Avrithis
• Keywords: MMSP 2008, Multimedia, Semantic, Spatiotemporal Video Segmentation, Video Shot