An interactive scene annotation tool for video surveillance is presented in this paper. The annotation process is divided into three stages. 1) Camera rough calibration; 2) Calibration refinement; 3) Major surfaces annotation. Inputs are then rendered in a 3D environment, which again help users check calibration accuracy and annotation correctness. Experiments show that this tool is easy to use and attains acceptable annotation accuracy. The interactive procedure helps users without knowledge in computer vision to complete camera calibration as well as surface annotation.