In the presented article we discuss and detail the general methodological approaches, the reconstruction strategies and the techniques that have been employed to achieve the 3D interactive real-time virtual visualization of the digitally restituted inhabited ancient sites of Aspendos and Pompeii, respectively simulated using a virtual and an augmented reality setup. More specifically, the two case studies to which we will refer to illustrate our general methodology concern the VR restitution of the Roman theatre of Aspendos in Turkey, visualized as it was in the 3rd century, and the on-site AR simulation of a digitally restored Thermopolium situated at the archeological site of Pompeii in Italy. In order to enhance both simulated 3D environments, either case study presents the inclusion of real time animated virtual humans which are re-enacting situations and activities that were typically performed in such sites during ancient times. Furthermore, the implemented modelling and illumin...