Learning to recognize or predict sequences using long-term context has many applications. However, practical and theoretical problems are found in training recurrent neural networ...
We describe an extension to the Mixture of Experts architecture for modelling and controlling dynamical systems which exhibit multiple modesof behavior. This extension is based on...
This paper introduces GNARL, an evolutionary program which induces recurrent neural networks that are structurally unconstrained. In contrast to constructive and destructive algor...
Gregory M. Saunders, Peter J. Angeline, Jordan B. ...
Stochastic optimization algorithms typically use learning rate schedules that behave asymptotically as (t) = 0=t. The ensemble dynamics (Leen and Moody, 1993) for such algorithms ...