Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/18744
Title: Hidden neuron pruning of multilayer perceptrons using a quantified sensitivity measure
Authors: Zeng, X
Yeung, DS
Keywords: Multilayer perceptron
Neural network
Neuron pruning
Relevance measure
Sensitivity measure
Issue Date: 2006
Publisher: Elsevier Science Bv
Source: Neurocomputing, 2006, v. 69, no. 7-9 spec. iss., p. 825-837 How to cite?
Journal: Neurocomputing 
Abstract: In the design of neural networks, how to choose the proper size of a network for a given task is an important and practical problem. One popular approach to tackling this problem is to start with an oversized network and then prune it to a smaller size so as to achieve less computational complexity and better performance in generalization. This paper presents a pruning technique, by means of a quantified sensitivity measure, to remove as many neurons as possible, those with the least relevance, from the hidden layer of a multilayer perceptron (MLP). The sensitivity of an individual neuron is defined as the expectation of its output deviation due to expected input deviation with respect to overall inputs from a continuous interval, and the relevance of the neuron is defined as the multiplication of its sensitivity value by the summation of the absolute values of its outgoing weights. The basic idea for introducing such a relevance measure is that a neuron with less relevance ought to have less effect on its succeeding neurons and thus contribute less to the entire network. The pruning is performed by iteratively training a network to a certain performance criterion and then removing the hidden neuron with the lowest relevance value until no one can further be removed. The pruning technique is novel in its quantified sensitivity measure and so is its relevance measure. Experimental results demonstrate the effectiveness of the pruning technique.
URI: http://hdl.handle.net/10397/18744
ISSN: 0925-2312
DOI: 10.1016/j.neucom.2005.04.010
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

44
Citations as of Jan 13, 2017

WEB OF SCIENCETM
Citations

31
Last Week
0
Last month
0
Citations as of Dec 14, 2016

Page view(s)

18
Last Week
0
Last month
Checked on Jan 15, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.