3-D live: real time interaction for mixed reality

We describe a real-time 3-D augmented reality videoconferencing system. With this technology, an observer sees the real world from his viewpoint, but modified so that the image of a remote collaborator is rendered into the scene. We register the image of the collaborator with the world by estimating the 3-D transformation between the camera and a fiducial marker. We describe a novel shape- from-silhouette algorithm, which generates the appropriate view of the collaborator and the associated depth map at 30 fps. When this view is superimposed upon the real world, it gives the strong impression that the collaborator is a real part of the scene. We also demonstrate interaction in virtual environments with a "live" fully 3-D collaborator. Finally, we consider interaction between users in the real world and collaborators in a virtual space, using a "tangible" AR interface. Keywords Video-Conferencing, Augmented Reality, Image Based Rendering, Shape from Silhouette, Inte...

• Type: Journal
• Year: 2002
• Where: CSCW
• Authors: Simon Prince, Adrian David Cheok, Farzam Farbiz, Todd Williamson, Nikolas Johnson, Mark Billinghurst, Hirokazu Kato
• Keywords: 3-D Augmented Reality, Augmented Reality, CSCW 2002, Real World, Social Sciences