Robust motion estimation is obtained by integrating optical flow and region tracking methods into a closedloop architecture. To ensure robust tracking over long intervals in video image sequences, the system has mechanisms to predict and assess tracking performance. Our application is to constrain the estimation of the 3D motion of a camera.