—Exergaming as a tool to combat obesity yields an interesting take on the problem of design and implementation of activity recognition systems for truly mobile games that achieve moderate levels of intensity. This work presents SoccAR, a mobile, sensor-based wearable exergaming system with fine-grain activity recognition. The system in this paper presents a recognition algorithm for the appropriate classification of 26 movements by extracting a large number of features and selecting the most important, as well as developing a multiple model strategy to better classify movements. This movement strategy allows for a trade off of detailed classification versus classification speed. A metric to define the accuracy in terms of the importance of particular movements is defined. The scheme presented develops a framework for more accurately classifying movements with a smaller number of features for a large, multiclass real-time environment. This results in a more accurate classificat...