Stochastic Flow Models (SFMs) are stochastic ystems that abstract the dynamics of complex discrete event systems involving the control of sharable resources. SFMs have been used to date to study systems with a single user class or some multiclass settings in which performance metrics are not class-dependent. In this paper, we develop a SFM framework for multiple classes and class-dependent performance objectives in which we can analyze new, occasionally counterintuitive, phenomena and give rise to a new type of "induced" events that capture delays in the SFM dynamics. In the case of two classes, we derive Infinitesimal Perturbation Analysis (IPA) estimators for their derivatives and use them as the basis for on-line optimization algorithms that apply to the underlying discrete event system (not the SFM). This allows us for the first time in the use of SFMs to contrast system-centric and user-centric objectives.
Chen Yao, Christos G. Cassandras