: Over the past years, the interaction between humans and computers (HCI) evolved to one of the most important research topics in computer science. Therefore, finding a way for an intuitive, easy and affordable interaction is the main challenge. Optical markerless tracking using consumer hardware can satisfy these problems. However, in order to be able to interact in an efficient way, the tracking and furthermore the interaction must be handled in real time. This leads to efficient use of current GPUs in order to speed up the tracking and furthermore the gesture recognition. Involving these issues, an approach for an implementation and system will be presented in the following paper.