—This paper describes a new three-dimensional spatiotemporal template, namely the Volumetric Motion History Image (VMHI), for the purpose of human motion analysis. Irregularities in human actions typically occur either in speed or orientation; they carry information about the balance and the confidence level of the human subject performing the activity. The proposed VMHI template handles successfully shortcomings of existing spatiotemporal templates related to motion self-occlusion and speed. Therefore, VMHI allows for interactive visualization, as well as quantification of motion performance. This study focuses on the analysis of sway and speed-related abnormalities, which are among the most common motion irregularities in the studied set of human actions.