In this paper, we first describe our approach to measuring the surface shape of specular objects and then we extend the method to measuring the surface shape of transparent objects by using stereo cameras and a display. We show that two viewpoints can uniquely determine the surface shape and surface normal by investigating the light path for each surface point. We can determine the light origin for each surface point by showing two-dimensional phase shifts on the display. We obtained dense and accurate results for both planar surfaces and curved surfaces.