We present a shape based method for automatic people detection and counting without any assumption or knowledge of camera motion. The proposed method is applied to athletic videos in order to classify them to videos of individual and team sports. Moreover, in the case of team (multi-agent) sport, we propose a shape deformations based method for running/hurdling discrimination (activity recognition). Robust, adaptive and independent from the camera motion, the proposed features are combined within the Transferable Belief Model (TBM) framework providing a two level (frames and shot) video categorization. The TBM allows to take into account imprecision, uncertainty and conflict inherent to the features into the fusion process. We have tested the proposed scheme into a big variety of athletic videos like pole vault, high jump, triple jump, hurdling, running, etc. The experimental results of 97% individual/team sport categorization accuracy, using a dataset of 252 real videos of athletic m...