In this paper, we present the design of a flexible framework for an IP-based network that will support an interactive multimedia (MM) system. The system will enable end users to: 1) author their own MM presentations, 2) control the delivery of the presentation, and 3) interact with the content (media objects) to make changes to the presentation in real time. To facilitate the design of the system we have introduced the concept of a meta object and have defined three levels of user interactivity: Presentation level interactivity, Session level interactivity, and Local level interactivity: