The migration of the Internet from classic computer communication to a platform for multimedia applications with real-time communication requires end-to-end improvements of the network-level service. The proposal known as Differentiated Services is a very promising approach for implementing quality of service in the Internet and is being discussed and developed. The challenge is to deliver end-to-end QoS on top of Differentiated Services considering multiple concurrent applicationlevel data streams. In this paper, we propose a QoS management system for multimedia servers that benefits from the scaling properties of layered media streams. This enables the system to map application QoS demands to available network resources and to adapt the quality of individual streams according to inter-stream QoS dependencies.