Abstract
Prediction intervals offer a means of assessing the uncertainty of artificial neural networks’ point predictions. In this work, we propose a hybrid approach for constructing prediction intervals, combining the Bootstrap method with a direct approximation of lower and upper error bounds. The main objective is to construct high-quality prediction intervals – combining high coverage probability for future observations with small and thus informative interval widths – even when sparse data is available. The approach is extended to adaptive approximation, whereby an online learning scheme is proposed to iteratively update prediction intervals based on recent measurements, requiring a reduced computational cost compared to offline approximation. Our results suggest the potential of the hybrid approach to construct high-coverage prediction intervals, in batch and online approximation, even when data quantity and density are limited. Furthermore, they highlight the need for cautious use and evaluation of the training data to be used for estimating prediction intervals.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2006)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer, New York (2009). https://doi.org/10.1007/978-0-387-84858-7
Hwang, J.T.G., Ding, A.A.: Prediction intervals for artificial neural networks. J. Am. Stat. Assoc. 92, 748–757 (1997)
Davidson, A.C., Hinkley, D.V.: Bootstrap Methods and Their Application. Cambridge University Press, Cambridge (2013)
Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans. Neural Netw. 22, 337–346 (2011)
Reppa, V., Polycarpou, M.M., Panayiotou, C.G.: Adaptive approximation for multiple sensor fault detection and isolation of nonlinear uncertain systems. IEEE Trans. Neural Netw. Learn. Syst. 25, 137–153 (2014)
Zhang, C., Wei, H., Xie, L., Shen, Y., Zhang, K.: Direct interval forecasting of wind speed using radial basis function neural networks in a multi-objective optimization framework. Neurocomputing 205, 53–63 (2016)
Ye, L., Zhou, J., Gupta, H.V., Zhang, H., Zeng, X., Chen, L.: Efficient estimation of flood forecast prediction intervals via single and multi-objective versions of the LUBE method. Hydrol Process. 30, 2703–2716 (2016)
Pearce, T., Zaki, M., Brintrup, A., Neely, A.: High-quality prediction intervals for deep learning: a distribution-free, ensembled approach. In: 35th International Conference on Machine Learning. arXiv:1802.07167v3 (2018)
Khosravi, A., Nahavandi, S., Creighton, D.: Prediction intervals for short-term wind farm power generation forecasts. IEEE Trans. Sustain. Energy 4, 602–610 (2013)
Lakshminarayanan, B., Pritzel, A., Blundell, C.: Simple and scalable predictive uncertainty estimation using deep ensembles. In: 31st Conference on Neural Information Processing Systems (2017)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6, 182–197 (2002)
Acknowledgements
This work has been supported by the European Union’s Horizon 2020 Research and Innovation Programme under grant agreement No 739551 (KIOS CoE) and from the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Hadjicharalambous, M., Polycarpou, M.M., Panayiotou, C.G. (2018). Online Approximation of Prediction Intervals Using Artificial Neural Networks. In: Kůrková, V., Manolopoulos, Y., Hammer, B., Iliadis, L., Maglogiannis, I. (eds) Artificial Neural Networks and Machine Learning – ICANN 2018. ICANN 2018. Lecture Notes in Computer Science(), vol 11139. Springer, Cham. https://doi.org/10.1007/978-3-030-01418-6_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-01418-6_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01417-9
Online ISBN: 978-3-030-01418-6
eBook Packages: Computer ScienceComputer Science (R0)