Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/711
Title: Minimum description length neural networks for time series prediction
Authors: Small, M
Tse, CKM 
Keywords: Algorithms
Computer simulation
Data reduction
Extrapolation
Information analysis
Iterative methods
Polynomials
Radial basis function networks
Real time systems
Time series analysis
Issue Date: Dec-2002
Publisher: American Physical Society
Source: Physical review E, statistical, nonlinear, and soft matter physics, Dec. 2002, v. 66, no. 6, 066701, p. 1-12 How to cite?
Journal: Physical review E, statistical, nonlinear, and soft matter physics 
Abstract: Artificial neural networks (ANN) are typically composed of a large number of nonlinear functions (neurons) each with several linear and nonlinear parameters that are fitted to data through a computationally intensive training process. Longer training results in a closer fit to the data, but excessive training will lead to overfitting. We propose an alternative scheme that has previously been described for radial basis functions (RBF). We show that fundamental differences between ANN and RBF make application of this scheme to ANN nontrivial. Under this scheme, the training process is replaced by an optimal fitting routine, and overfitting is avoided by controlling the number of neurons in the network. We show that for time series modeling and prediction, this procedure leads to small models (few neurons) that mimic the underlying dynamics of the system well and do not overfit the data. We apply this algorithm to several computational and real systems including chaotic differential equations, the annual sunspot count, and experimental data obtained from a chaotic laser. Our experiments indicate that the structural differences between ANN and RBF make ANN particularly well suited to modeling chaotic time series data.
URI: http://hdl.handle.net/10397/711
ISSN: 1063-651X
DOI: 10.1103/PhysRevE.66.066701
Rights: Copyright 2002 by the American Physical Society
Appears in Collections:Journal/Magazine Article

Files in This Item:
File Description SizeFormat 
series-prediction_02.pdf150.57 kBAdobe PDFView/Open
Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

60
Last Week
0
Last month
Citations as of Feb 5, 2016

WEB OF SCIENCETM
Citations

47
Last Week
0
Last month
Citations as of Feb 5, 2016

Page view(s)

267
Checked on Feb 7, 2016

Google ScholarTM
Citations

loading...

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.