Cost-Effective Solution to Synchronized Audio-Visual Capture Using Multiple Sensors

Abstract—Applications such as surveillance and human motion capture require high-bandwidth recording from multiple cameras. Furthermore, the recent increase in research on sensor fusion has raised the demand on synchronization accuracy between video, audio and other sensor modalities. Previously, capturing synchronized, high resolution video from multiple cameras required complex, inflexible and expensive solutions. Our experiments show that a single PC, built from contemporary low-cost computer hardware, could currently handle up to 470MB/s of input data. This allows capturing from 18 cameras of 780x580pixels at 60fps each, or 36 cameras at 30fps. Furthermore, we achieve accurate synchronization between audio, video and additional sensors, by recording audio together with sensor trigger- or timestamp signals, using a multi-channel audio input. In this way, each sensor modality can be captured with separate software and hardware, allowing maximal flexibility with minimal cost. Keyw...

• Type: Conference
• Year: 2009
• Where: AVSS
• Authors: Jeroen Lichtenauer, Michel François Valstar, Jie Shen, Maja Pantic
• Keywords: AVSS 2009, Multiple Cameras, Sensor, Sensor Fusion, Signal Processing