We describe a system for analyzing human driver alertness. It relies on optical flow and color predicates to robustly track a person’s head and facial features. Our system classifies rotation in all viewing directions, detects eye/mouth occlusion, detects eye blinking, and recovers the 3D gaze of the eyes. We show results and discuss how this system can be used for monitoring driver alertness.