We present a computer system for natural interaction in an augmented virtual environment, enabling people to play table tennis over Internet/LAN with real rackets. No special hardware is required except for the web cameras. The pose of the rackets is computed by marker detection from the image. The players see each other in the camera image, which is streamed real time over the network. The multicast implementation enables a network audience to view the game, too. Categories and Subject Descriptors H.4.3 [Information System Applications]: Communications Applications