Sciweavers

ATAL
2008
Springer

The permutable POMDP: fast solutions to POMDPs for preference elicitation

14 years 2 months ago
The permutable POMDP: fast solutions to POMDPs for preference elicitation
The ability for an agent to reason under uncertainty is crucial for many planning applications, since an agent rarely has access to complete, error-free information about its environment. Partially Observable Markov Decision Processes (POMDPs) are a desirable framework in these planning domains because the resulting policies allow the agent to reason about its own uncertainty. In domains with hidden state and noisy observations, POMDPs optimally trade between actions that increase an agent's knowledge and actions that increase an agent's reward. Unfortunately, for many real world problems, even approximating good POMDP solutions is computationally intractable without leveraging structure in the problem domain. We show that the structure of many preference elicitation problems--in which the agent must discover some hidden preference or desire from another (usually human) agent--allows the POMDP solution to be solved with exponentially fewer belief points than standard point-b...
Finale Doshi, Nicholas Roy
Added 12 Oct 2010
Updated 12 Oct 2010
Type Conference
Year 2008
Where ATAL
Authors Finale Doshi, Nicholas Roy
Comments (0)