On Finding Compromise Solutions in Multiobjective Markov Decision Processes

A Markov Decision Process (MDP) is a general model for solving planning problems under uncertainty. It has been extended to multiobjective MDP to address multicriteria or multiagent problems in which the value of a decision must be evaluated according to several viewpoints, sometimes conflicting. Although most of the studies concentrate on the determination of the set of Pareto-optimal policies, we focus here on a more specialized problem that concerns the direct determination of policies achieving wellbalanced tradeoffs. We first explain why this problem cannot simply be solved by optimizing a linear combination of criteria. This leads us to use an alternative optimality concept which formalizes the notion of best compromise solution, i.e. a policy yielding an expected-utility vector as close as possible (w.r.t. Tchebycheff norm) to a reference point. We show that this notion of optimality depends on the initial state. Moreover, it appears that the best compromise policy cannot be fou...

• Type: Conference
• Year: 2010
• Where: ECAI
• Authors: Patrice Perny, Paul Weng
• Keywords: Alternative Optimality Concept, Artificial Intelligence, ECAI 2010, Markov Decision Process, Multiobjective Mdp