We present a method for estimating the 3-D structure of the cortical surface using an operating microscope whose binocular optics are fitted with two CCD cameras. The cortical surface is then tracked over time and the measured displacement can be used to drive FEM-based models for the recovery of subsurface brain deformations. We show the efficacy of this technique on a clinical case.