Evolving policy geometry for scalable multiagent learning

A major challenge for traditional approaches to multiagent learning is to train teams that easily scale to include additional agents. The problem is that such approaches typically encode each agent's policy separately. Such separation means that computational complexity explodes as the number of agents in the team increases, and also leads to the problem of reinvention: Skills that should be shared among agents must be rediscovered separately for each agent. To address this problem, this paper presents an alternative evolutionary approach to multiagent learning called multiagent HyperNEAT that encodes the team as a pattern of related policies rather than as a set of individual agents. To capture this pattern, a policy geometry is introduced to describe the relationship between each agent's policy and its canonical geometric position within the team. Because policy geometry can encode variations of a shared skill across all of the policies it represents, the problem of reinve...

• Type: Conference
• Year: 2010
• Where: ATAL
• Authors: David B. D'Ambrosio, Joel Lehman, Sebastian Risi, Kenneth O. Stanley
• Keywords: ATAL 2010, Intelligent Agents, Multiagent Learning, Policy Geometry, Team