Integrated Analytic Framework for Neural Network Construction

Abstract. This paper investigates the construction of a wide class of singlehidden layer neural networks (SLNNs) with or without tunable parameters in the hidden nodes. It is a challenging problem if both the parameter training and determination of network size are considered simultaneously. Two alternative network construction methods are considered in this paper. Firstly, the discrete construction of SLNNs is introduced. The main objective is to select a subset of hidden nodes from a pool of candidates with parameters fixed ‘a priori’. This is called discrete construction since there are no parameters in the hidden nodes that need to be trained. The second approach is called continuous construction as all the adjustable network parameters are trained on the whole parameter space along the network construction process. In the second approach, there is no need to generate a pool of candidates, and the network grows one by one with the adjustable parameters optimized. The main contr...

• Type: Conference
• Year: 2007
• Where: ISNN
• Authors: Kang Li, Jian Xun Peng, Minrui Fei, Xiaoou Li, Wen Yu
• Keywords: Hidden Nodes, ISNN 2007, Network Construction, Parameters