Abstract
A new model for nowcasting fog events in the coastal desert area of Dubai is presented, based on a machine-learning algorithm—decision-tree induction. In the investigated region high frequency observations from automatic weather stations were utilized as a database for the analysis of useful patterns. The induced decision trees yield for the first six forecasting hours increased prediction skill when compared to the coupled Weather Research and Forecasting (WRF) model and the PAFOG fog model (Bartok et al., Boundary-Layer Meteorol 145:485–506, 2012). The decision tree results were further improved by integrating the output of the coupled numerical fog forecasting models in the training database of the decision tree. With this treatment, the statistical quality measures, i.e. the probability of detection, the false alarm ratio, and the Gilbert’s skill score, achieved values of 0.88, 0.19, and 0.69, respectively. From these results we conclude that the best fog forecast in the Dubai region is obtained by applying for the first six forecast hours the newly-developed machine-learning algorithm, while for forecast times exceeding 6 h the coupled numerical models are the best choice.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bartok J, Bott A, Gera M (2012) Fog prediction for road traffic safety in a coastal desert region. Boundary-Layer Meteorol 145(3):485–506. doi:10.1007/s10546-012-9750-5
Bartok J, Babič F, Bednár P, Paralič J, Kováč J, Bartoková I, Hluchỳ L, Gera M (2013) Data mining for fog prediction and low clouds detection. Comput Inf 31(6):1441–1464
Bott A, Trautmann T (2002) Pafog—a new efficient forecast model of radiation fog and low-level stratiform clouds. Atmos Res 64:191–203
Bott A, Sievers U, Zdunkowski W (1990) A radiation fog model with a detailed treatment of the interaction between radiative transfer and fog microphysics. J Atmos Sci 47:2153–2166
Bott A, Trautmann T, Zdunkowski W (1996) A numerical model of the cloud-topped planetary boundary-layer: radiation, turbulence and spectral microphysics in marine stratus. Q J R Meteorol Soc 122:635–667
Breiman L (1984) Classification and regression trees. Chapman & Hall/CRC, London, 368 pp
Breiman L (2001) Random forests. Mach Learn 45(1):5–32
Chapman P, Clinton J, Kerber R, Khabaza T, Reinartz T, Shearer C, Wirth R (2000) CRISP-DM 1.0 Step-by-step data mining guide. Tech. Rep., The CRISP-DM consortium
Chaumerliac N, Richard E, Pinty J (1987) Sulfur scavenging in a mesoscale model with quasi-spectral microphysics: two-dimensional results for continental and maritime clouds. J Geophys Res 92:3114–3126
Fabbian D, de Dear R, Lellyett S (2007) Application of artificial neural network forecasts to predict fog at Canberra international airport. Weather Forecast 22:372–381. doi:10.1175/WAF980.1
Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) From data mining to knowledge discovery in databases. AI Mag 17(3):1–37
Gardner MW, Dorling SR (1998) Artificial neural networks (the multilayer perceptron)—a review of applications in the atmospheric sciences. Atmos Environ 32:2627–2636
Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. SIGKDD Explor Newsl 11(1):10–18. doi:10.1145/1656274.1656278
Hastie T, Tibshirani R et al (1998) Classification by pairwise coupling. Ann Stat 26(2):451–471
Hluchý L, Habala O, Krammer P, Seleng M, Tran VD (2011) Experiments in applying advanced data mining and integration to hydro-meteorological scenarios. In: ICSDM. IEEE, Fuzhou, pp 279–284
Keerthi SS, Shevade SK, Bhattacharyya C, Murthy KRK (2001) Improvements to Platt’s SMO algorithm for SVM classifier design. Neural Comput 13(3):637–649
Kohavi R, John GH (1997) Wrappers for feature subset selection. Artif Intell 97(1–2):273–324
Lakshmanan V, Elmore KL, Richman MB (2010) Reaching scientific consensus through a competition. Bull Am Meteorol Soci 91(10):1423–1427
Marzban C (1998) Scalar measures of performance in rare-event situations. Weather Forecast 13:753–763
Mehrotra K, Mohan CK, Ranka S (1997) Elements of artificial neural networks. The MIT Press, Cambridge, 334 pp
Mellor G, Yamada T (1974) A hierarchy of turbulence closure models for planetary boundary layers. J Atmos Sci 31:1791–1806
Mellor G, Yamada T (1982) Development of a turbulence closure model for geophysical fluid problems. Rev Geophys Space Phys 20:851–875
Mitchell TM (1997) Machine learning. McGraw-Hill Inc, New York, 432 pp
Nickerson E, Richard E, Rosset R, Smith D (1986) The numerical simulation of clouds, rain and airflow over the Vosges and Black Forest mountains: a meso-h model with parameterized microphysics. Mon Weather Rev 114:398–414
Nugroho AS, Kuroyanagi S, Iwata A (2000) Fog forecasting using self growing neural network CombNET-II—a solution for imbalanced training sets problem. In: Proceedings of the international joint conference on neural networks, vol 4, pp 429–434
Pielke R (1984) Mesoscale meteorological modeling. Academic Press, Orlando, 612 pp
Quinlan JR (1987) Rule induction with statistical data—a comparison with multiple regression. J Oper Res Soc 38:347–352
Quinlan JR (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers Inc., San Francisco
Schoelkopf B, Burges CJC, Smola AJ (1999) Advances in kernel methods—support vector learning. MIT Press, Cambridge, 376 pp
Siebert J, Bott A, Zdunkowski W (1992a) Influence of a vegetation-soil model on the simulation of radiation fog. Beitr Phys Atmos 65:93–106
Siebert J, Sievers U, Zdunkowski W (1992b) A one-dimensional simulation of the interaction between land surface processes and the atmosphere. Boundary-Layer Meteorol 59:1–34
Skamarock W, Klemp J, Dudhia J, Gill D, Barker D, Duda M, Huang X, Wang W, Powers J (2008) A description of the advanced research WRF version 3. Tech. Rep., NCAR Technical Note
Tan PN, Steinbach M, Kumar V (2006) Introduction to data mining. Addison-Wesley, Boston, 769 pp
Weymouth GT, Boneh T, Newham P, Bally J, Potts R, Nicholson A, Korb K (2010) Dealing with uncertainty in fog forecasting for major airports in Australia. In: 4th conference on fog. Fog Collection and Dew, La Serena, Chile, pp 73–76
Wilks D (2006) Statistical methods in the atmospheric sciences, vol 91, 2nd edn. International geophysics series. Academic Press, New York, 627 pp
Zazzaro G, Pisano FM, Mercogliano P (2010) Data mining to classify fog events by applying cost-sensitive classifier. In: International conference on complex, intelligent and software intensive systems, pp 1093–1098
Zdunkowski W, Panhans W, Welch R, Korb G (1982) A radiation scheme for circulation and climate models. Beitr Phys Atmos 55:215–238
Acknowledgments
This research was supported by the Competence Center for SMART Technologies for Electronics and Informatics Systems and Services, ITMS 26240220072, funded by the Research and Development Operational Programme from the ERDF.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bartoková, I., Bott, A., Bartok, J. et al. Fog Prediction for Road Traffic Safety in a Coastal Desert Region: Improvement of Nowcasting Skills by the Machine-Learning Approach. Boundary-Layer Meteorol 157, 501–516 (2015). https://doi.org/10.1007/s10546-015-0069-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10546-015-0069-x