Identifying useful subgoals in reinforcement learning by local graph partitioning

We present a new subgoal-based method for automatically creating useful skills in reinforcement learning. Our method identifies subgoals by partitioning local state transition graphs--those that are constructed using only the most recent experiences of the agent. The local scope of our subgoal discovery method allows it to successfully identify the type of subgoals we seek--states that lie between two densely-connected regions of the state space--while producing an algorithm with low computational cost.

• Type: Conference
• Year: 2005
• Where: ICML
• Authors: Özgür Simsek, Alicia P. Wolfe, Andrew G. Barto
• Keywords: ICML 2005, Local State Transition, Machine Learning, Method Identifies Subgoals, Subgoal Discovery Method