Touch projector: mobile interaction through video

In 1992, Tani et al. proposed remotely operating machines in a factory by manipulating a live video image on a computer screen. In this paper we revisit this metaphor and investigate its suitability for mobile use. We present Touch Projector, a system that enables users to interact with remote screens through a live video image on their mobile device. The handheld device tracks itself with respect to the surrounding displays. Touch on the video image is “projected” onto the target display in view, as if it had occurred there. This literal adaptation of Tani’s idea, however, fails because handheld video does not offer enough stability and control to enable precise manipulation. We address this with a series of improvements, including zooming and freezing the video image. In a user study, participants selected targets and dragged targets between displays using the literal and three improved versions. We found that participants achieved highest performance with automatic zooming an...

• Type: Conference
• Year: 2010
• Where: CHI
• Authors: Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, Patrick Baudisch
• Keywords: CHI 2010, Human Computer Interaction, Live Video Image, Mobile Device, Video Image