FingARtips: gesture based direct manipulation in Augmented Reality

This paper presents a technique for natural, fingertip-based interaction with virtual objects in Augmented Reality (AR) environments. We use image processing software and finger- and hand-based fiducial markers to track gestures from the user, stencil buffering to enable the user to see their fingers at all times, and fingertip-based haptic feedback devices to enable the user to feel virtual objects. Unlike previous AR interfaces, this approach allows users to interact with virtual content using natural hand gestures. The paper describes how these techniques were applied in an urban planning interface, and also presents preliminary informal usability results. CR Categories: H.5.1 [Information Systems]: Multimedia Information Systems – Artificial, augmented, and virtual realities; H.5.2 [Information Systems]: User Interfaces – Haptic I/O; I.3.6 [Computer Graphics]: Methodology and Techniques – Interaction techniques

• Type: Conference
• Year: 2004
• Where: GRAPHITE
• Authors: Volkert Buchmann, Stephen Violich, Mark Billinghurst, Andy Cockburn
• Keywords: Fingertip-based Haptic Feedback, GRAPHITE 2004, Information Systems, Virtual Objects