In this paper, we propose a robust technique that integrates spatial and temporal information for consistent recovery of the endocardium. To account for the low image quality we introduce a local variant of the Mumford-Shah that is coupled with a model of limited parameters to describe the ventricle, namely an ellipse. The objective function is defined on the implicit space of ellipses, separates locally the blood pool from the heart wall and explores geometric constraints on the deformations of the endocardium to impose temporal consistency. Promising experimental results demonstrate the potentials of our method.