Topology Dictionary with Markov Model for 3D Video Content-Based Skimming and Description

This paper presents a novel approach to skim and describe 3D videos. 3D video is an imaging technology which consists in a stream of 3D models in motion captured by a synchronized set of video cameras. Each frame is composed of one or several 3D models, and therefore the acquisition of long sequences at video rate requires massive storage devices. In order to reduce the storage cost while keeping relevant information, we propose to encode 3D video sequences using a topology-based shape descriptor dictionary. This dictionary is either generated from a set of extracted patterns or learned from training input sequences with semantic annotations. It relies on an unsupervised 3D shape based clustering of the dataset by Reeb graphs, and features a Markov network to characterize topological changes. The approach allows content-based compression and skimming with accurate recovery of sequences and can handle complex topological changes. Redundancies are detected and skipped based on a probabi...

• Type: Conference
• Year: 2009
• Where: CVPR
• Authors: Tony Tung (Kyoto University), Takashi Matsuyama (Kyoto University)
• Keywords: 3D Video, Computer Vision, CVPR 2009, Reeb Graph