Global Versus Local Constructive Function Approximation for On-Line Reinforcement Learning

: In order to scale to problems with large or continuous state-spaces, reinforcement learning algorithms need to be combined with function approximation techniques. The majority of work on function approximation for reinforcement learning has so far focused either on global function approximation with a static structure (such as multi-layer perceptrons), or on constructive architectures using locally responsive units. The former, whilst achieving some notable successes, has also been shown to fail on some relatively simple tasks. The locally constructive approach has been shown to be more stable, but may scale poorly to higherdimensional inputs, as it will require a dramatic increase in resources. This paper explores the use of two constructive algorithms using non-locally responsive neurons based on the popular Cascade-Correlation supervised-learning algorithm. The algorithms are applied within the sarsa reinforcement learning algorithm, and their performance compared against both a m...

• Type: Conference
• Year: 2005
• Where: AUSAI
• Authors: Peter Vamplew, Robert Ollington
• Keywords: Artificial Intelligence, AUSAI 2005, Constructive, Function Approximation, Reinforcement Learning