This paper briefly describes a scalable architecture for implementing autonomous agents that act in a virtual world created for a computer game and must interact with it by suitably planning and executing actions in a dynamic and notcompletely accessible environment. In particular, we are experimenting a two-pass vertically layered architecture that allows supporting an agent behavior through a clean hierarchical organization.