Aiming at improving image segmentation and extending regular computer vision algorithms an image sensor, acquiring additional depth information is deployed. The novel Photonic Mixer Device (PMD) technology will be summarized, by which it becomes possible to measure the observed object’s distance to the camera. Motivated by expanding and making existing image processing and segmentation algorithms more robust, the additional depth information is overlapped with the image map gained by a regular camera system. Due to the fact of the used cameras are displaced and have different image resolutions, a sophisticated calibration algorithm will be introduced. By applying improved algorithms to applications, such as people counting, gesture recognition, and barrier detection its effectiveness will be shown.