This article presents an efficient approach to eye movement estimation by combining color and energy based image analysis algorithms. The movement is first analyzed and then described in terms of action units. A temporal state diagram is used to control the behavior of the analysis over the time so the movement of the eye can be synthesized from the former description, after translating them into face animation parameters.