Home > Research > Publications & Outputs > An Evaluation of Neural Network Ensembles and M...
View graph of relations

An Evaluation of Neural Network Ensembles and Model Selection for Time Series Prediction

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Published
Publication date2010
Host publicationThe 2010 International Joint Conference on Neural Networks (IJCNN)
Place of PublicationNew York
PublisherIEEE
Pages1-8
Number of pages8
ISBN (print)978-1-4244-6917-8
<mark>Original language</mark>English

Abstract

Ensemble methods represent an approach to combine a set of models, each capable of solving a given task, but which together produce a composite global model whose accuracy and robustness exceeds that of the individual models. Ensembles of neural networks have traditionally been applied to machine learning and pattern recognition but more recently have been applied to forecasting of time series data. Several methods have been developed to produce neural network ensembles ranging from taking a simple average of individual model outputs to more complex methods such as bagging and boosting. Which ensemble method is best; what factors affect ensemble performance, under what data conditions are ensembles most useful and when is it beneficial to use ensembles over model selection are a few questions which remain unanswered. In this paper we present some initial findings using neural network ensembles based on the mean and median applied to forecast synthetic time series data. We vary factors such as the number of models included in the ensemble and how the models are selected, whether randomly or based on performance. We compare the performance of different ensembles to model selection and present the results.