In this paper we present a novel image-based 3D surface reconstruction technique that incorporates both reflectance and polarisation features into a variational framework. Our technique is especially suited for the difficult task of 3D reconstruction of rough metallic surfaces. An error functional consisting of several error terms related to the measured reflectance and polarisation properties is minimised in order to obtain a 3D reconstruction of the surface. We show that the combined approach strongly increases the accuracy of the surface reconstruction result, compared to techniques based on either reflectance or polarisation alone. We evaluate the algorithm based on synthetic ground truth data. Furthermore, we report 3D reconstruction results for a raw forged iron surface, thus showing the applicability of our method in real-world scenarios, here in the domain of quality inspection in the automotive industry.