Generalized Point Based Value Iteration for Interactive POMDPs

We develop a point based method for solving finitely nested interactive POMDPs approximately. Analogously to point based value iteration (PBVI) in POMDPs, we maintain a set of belief points and form value functions composed of those value vectors that are optimal at these points. However, as we focus on multiagent settings, the beliefs are nested and computation of the value vectors relies on predicted actions of others. Consequently, we develop a novel interactive generalization of PBVI applicable to multiagent settings.

• Type: Conference
• Year: 2008
• Where: AAAI
• Authors: Prashant Doshi, Dennis Perez
• Keywords: AAAI 2008, Form Value Functions, Intelligent Agents, Multiagent Settings, Value Vectors