Boosting the Performance of RBF Networks with Dynamic Decay Adjustment

Radial Basis Function (RBF) Networks, also known as networks of locally{tuned processing units (see 6]) are well known for their ease of use. Most algorithms used to train these types of networks, however, require a xed architecture, in which the number of units in the hidden layer must be determined before training starts. The RCE training algorithm, introduced by Reilly, Cooper and Elbaum (see 8]), and its probabilistic extension, the P{RCE algorithm, take advantage of a growing structure in which hidden units are only introduced when necessary. The nature of these algorithms allows training to reach stability much faster than is the case for gradient{descent based methods. Unfortunately P{RCE networks do not adjust the standard deviation of their prototypes individually, using only one global value for this parameter. This paper introduces the Dynamic Decay Adjustment (DDA) algorithm which utilizes the constructive nature of the P{RCE algorithm together with independent adaptation ...

• Type: Conference
• Year: 1994
• Where: NIPS
• Authors: Michael R. Berthold, Jay Diamond
• Keywords: Algorithm, NIPS 1994, NIPS 2007, P{RCE Algorithm, RCE Training Algorithm