Haptic Interaction with Depth Video Media

Abstract. In this paper we propose a touch enabled video player system. A conventional video player only allows viewers to passively experience visual and audio media. In virtual environment, touch or haptic interaction has been shown to convey a powerful illusion of the tangible nature - the reality - of the displayed environments and we feel the same benefits may be conferred to a broadcast, viewing domain. To this end, this paper describes a system that uses a video representation based on depth images to add a haptic component to an audio-visual stream. We generate this stream through the combination of a regular RGB image and a synchronized depth image composed of per-pixel depth-from-camera information. The depth video, a unified stream of the color and depth images, can be synthesized from a computer graphics animation by rendering with commercial packages or captured from a real environment by using a active depth camera such as the ZcamT M . In order to provide a haptic repr...

• Type: Conference
• Year: 2005
• Where: PCM
• Authors: Jongeun Cha, Seung Man Kim, Ian Oakley, Jeha Ryu, Kwan-Heng Lee
• Keywords: Depth Images, Modified Proxy Graph, Multimedia, PCM 2005, Proxy Graph Algorithm