Abstract. Differential motion estimation is based on detecting brightness changes in local image structures. Filters approximating the local gradient are applied to the image sequence for this purpose. Whereas previous approaches focus on the reduction of the systematical approximation error of filters and motion models, the method presented in this paper is based on the statistical characteristics of the data. We developed a method for adapting separable linear shift invariant filters to image sequences or whole classes of image sequences. Therefore, it is possible to optimize the filters according to the systematical errors as well as to the statistical ones.