We propose a region-based method for model-free object tracking. In our method the object information of temporal motion and spatial luminance are fully utilized. We first compute dominant motion of the tracked object. Using this result we warp the object template to generate a prediction template. Static segmentation is incorporated to modify this prediction, where the warping error of each watershed segment and its rate of overlapping with warped template are utilized to help classification of some possible watershed segments near the object border. Applications of facial expression tracking and two-handed gesture tracking demonstrate its performance.
Yu Huang, Thomas S. Huang, Heinrich Niemann