In this paper we propose a general framework for local pathplanning and steering that can be easily extended to perform highlevel behaviors. Our framework is based on the concept of affordances – the possible ways an agent can interact with its environment. Each agent perceives the environment through a set of vector and scalar fields that are represented in the agent’s local space. This egocentric property allows us to efficiently compute a local spacetime plan. We then use these perception fields to compute a fitness measure for every possible action, known as an affordance field. The action that has the optimal value in the affordance field is the agent’s steering decision. Using our framework, we demonstrate autonomous virtual pedestrians that perform steering and path planning in unknown environments along with the emergence of highlevel responses to never seen before situations. CR Categories: I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism—Animat...