Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images

: An important field of reasearch in computer vision is the 3D analysis and reconstruction of objects and scenes. A rather new technologie in this context is the Photonic Mixer Device (PMD), based on the time-of-flight principle, which measures full-range distance information in real-time. Unfortunately, PMD-based devices have still limited resolution and provide only IR intensity information. This paper describes a fast algorithmic approach to combine high resolution RGB images with PMD distance data, acquired using a binocular camera setup. The resulting combined RGBZ-data not only enhances the visual result, but also represents a basis for advanced data processing in e. g. object recognition with sub-pixel accuracy. A simple but efficient method is used to detect geometric occlusion caused by the binocular setup, which otherwise will lead to false color assignments. Additionally, we introduce an enhanced filtering technique used for the edge-enhanced distance refinement of the geome...

• Type: Journal
• Year: 2008
• Where: IJISTA
• Authors: Marvin Lindner, Martin Lambers, Andreas Kolb
• Keywords: Binocular Camera Setup, IJISTA 2008, Photonic Mixer Device, PMD Distance Data