Compositionality for Markov Reward Chains with Fast Transitions

A parallel composition is defined for Markov reward chains with fast transitions and for discontinuous Markov reward chains. In this setting, compositionality with respect to the relevant aggregation preorders is established. For Markov reward chains with fast transitions the preorders are -lumping and -reduction. Discontinuous Markov reward chains are `limits' of Markov reward chains with fast transitions, and have related notions of lumping and reduction. In total, four compositionality results are shown. In addition, the two parallel operators are related by a continuity property.

• Type: Conference
• Year: 2007
• Where: EPEW
• Authors: Jasen Markovski, Ana Sokolova, Nikola Trcka, Erik P. de Vink
• Keywords: Discontinuous Markov Reward, EPEW 2007, Fast Transitions, Internet Technology, Markov Reward Chains