Abstract
The delta technique has been proposed in literature for constructing prediction intervals for targets estimated by neural networks. Quality of constructed prediction intervals using this technique highly depends on neural network characteristics. Unfortunately, literature is void of information about how these dependences can be managed in order to optimize prediction intervals. This study attempts to optimize length and coverage probability of prediction intervals through modifying structure and parameters of the underlying neural networks. In an evolutionary optimization, genetic algorithm is applied for finding the optimal values of network size and training hyper-parameters. The applicability and efficiency of the proposed optimization technique is examined and demonstrated using a real case study. It is shown that application of the proposed optimization technique significantly improves quality of constructed prediction intervals in term of length and coverage probability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Paliwal, M., Kumar, U.A.: Neural networks and statistical techniques: A review of applications. Expert Systems with Applications 36, 2–17 (2009)
Hannula, M., Huttunen, K., Koskelo, J., Laitinen, T., Leino, T.: Comparison between artificial neural network and multilinear regression models in an evaluation of cognitive workload in a flight simulator. Computers in Biology and Medicine 38, 1163–1170 (2008)
Hwang, J.T.G., Ding, A.A.: Prediction Intervals for Artificial Neural Networks. Journal of the American Statistical Association 92, 748–757 (1997)
de Veaux, R.D., Schumi, J., Jason, S., Ungar, L.H.: Prediction Intervals for Neural Networks via Nonlinear Regression. Technometrics 40, 273–282 (1998)
Nix, D.A., Weigend, A.S.: Estimating the mean and variance of the target probability distribution. In: IEEE International Conference on Neural Networks (1994)
Papadopoulos, G., Edwards, P.J., Murray, A.F.: Confidence estimation methods for neural networks: a practical comparison. IEEE Transactions on Neural Networks 12, 1278–1287 (2001)
Khosravi, A., Nahavandi, S., Creighton, D.: Constructing Prediction Intervals for Neural Network Metamodels of Complex Systems. In: International Joint Conference on Neural Networks, IJCNN 2009 (2009)
Khosravi, A., Nahavandi, S., Creighton, D.: A Prediction Interval-Based Approach to Determine Optimal Structures of Neural Network Metamodels. Expert Systems with Applications (August 2009) (in Press) (accepted Manuscript)
Seber, G.A.F., Wild, C.J.: Nonlinear regression. Wiley, New York (1989)
Lu, T., Viljanen, M.: Prediction of indoor temperature and relative humidity using neural network models: model comparison. Neural Computing & Applications 18, 345–357 (2009)
Gen, M., Cheng, R.: Genetic algorithms and engineering design. Wiley, New York (1997)
Haupt, R.L., Haupt, S.E.: Practical genetic algorithms. Wiley, New York (1998)
Vonk, E., Jain, L.C., Johnson, R.P.: Automatic generation of neural network architecture using evolutionary computation. World Scientific, Singapore (1997)
Bornholdt, S., Graudenz, D.: General asymmetric neural networks and structure design by genetic algorithms. Neural Networks 5, 327–334 (1992)
Asuncion, A., Newman, D.J.: UCI Machine Learning Repository, Irvine, CA, University of California, School of Information and Computer Science (2009), http://www.ics.uci.edu/~mlearn/MLRepository.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khosravi, A., Nahavandi, S., Creighton, D. (2009). Improving Prediction Interval Quality: A Genetic Algorithm-Based Method Applied to Neural Networks. In: Leung, C.S., Lee, M., Chan, J.H. (eds) Neural Information Processing. ICONIP 2009. Lecture Notes in Computer Science, vol 5864. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10684-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-10684-2_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10682-8
Online ISBN: 978-3-642-10684-2
eBook Packages: Computer ScienceComputer Science (R0)