This paper deals with the problem of estimating structure of 3D scenes and image transformations from observations that are blurred due to unconstrained camera motion. Initially, we consider a fronto-parallel planar scene and relate the reference image of the scene to its motion-blurred observation by finding the reference image transformations. The blur kernel at every image point can be determined from these transformations. For 3D scenes, the extent of blurring in the image is related to the camera motion as well as the scene structure. We propose a technique to estimate the scene depth with the knowledge of the estimated image transformations. The proposed method is validated by testing on real and synthetic experiments.