Abstract. This work introduces a new interaction framework for dynamic virtual environments. The proposed system is designed to deal with all possible interactions in a virtual world. The idea is to build up a world of objects that contain their own interaction information. As a result the object interactions are application independent and a single scheme is required to handle all interactions in the virtual world. Furthermore, an object model description is designed that provides a means to describe the object’s functionality. This description can also be used by AI agents to plan or execute interactions with these objects.