Abstract
This paper highlights progress with the development of a petascale implementation of general-purpose high-resolution (nonoscillatory) hydrodynamical simulation code EULAG [Prusa et al. 2008, Comput. Fluids 37, 1193]. The applications addressed are anelastic atmospheric flows in the range of scales from micro to planetary. The new modeldomain decomposition into a three dimensional processor array has been implemented to increase model performance and scalability. The performance of the new code is demonstrated on the IBM BlueGene/L and Cray XT4/XT5 supercomputers. The results show significant improvement of the model efficacy compared to the original decomposition into a two-dimensional processor array in the horizontal — a standard in meteorological models.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andrejczuk, M., W.W. Grabowski, S.P. Malinowski, and P.K. Smolarkiewicz (2004), Numerical simulation of cloud-clear air interfacial mixing, J. Atmos. Sci. 61,14, 1726–1739, DOI: 10.1175/1520-0469(2004)061 〈1726:NSOCAI〉2.0.CO;2.
Andrejczuk, M., W.W. Grabowski, S.P. Malinowski, and P.K. Smolarkiewicz (2006)
Numerical simulation of cloud-clear air interfacial mixing: Effects on cloud microphysics, J. Atmos. Sci. 63,12, 3204–3225, DOI: 10.1175/JAS3813.1.
Cotter, C.S., P.K. Smolarkiewicz, and I.N. Szczyrba (2002), A viscoelastic fluid model for brain injuries, Int. J. Numer. Meth. Fluids 40,1–2, 303–311, DOI: 10.1002/fld.287.
Domaradzki, J.A., Z. Xiao, and P.K. Smolarkiewicz (2003), Effective eddy viscosities in implicit large eddy simulations of turbulent flows, Phys. Fluids 15,12, 3890–3893, DOI: 10.1063/1.1624610.
Drikakis, D., C. Fureby, F. Grinstein, and D. Youngs (2007), Simulation of transition and turbulence decay in the Taylor-Green vortex, J. Turbulence 8,20, 1–12, DOI: 10.1080/14685240701250289.
Ghizaru, M., P. Charbonneau, and P.K. Smolarkiewicz (2010), Magnetic cycles in global large-eddy simulations of solar convection, Astrophys. J. Lett. 715, L133–L137, DOI: 10.1088/2041-8205/715/2/L133.
Grabowski, W.W., and P.K. Smolarkiewicz (2002), A multiscale anelastic model for meteorological research, Month. Weather Rev. 130,4, 939–956, DOI: 10.1175/1520-0493(2002)130〈0939:AMAMFM〉0.2.CO;2.
Held, I.M., and M.J. Suarez (1994), A proposal for the intercomparison of the dynamical cores of atmospheric general circulation models, Bull. Amer. Meteor. Soc. 75,10, 1825–1830, DOI: 10.1175/1520-0477(1994)075〈1825: APFTIO〉2.0.CO;2.
Johnson, K.W., J. Bauer, G.A. Riccardi, and K.K. Droegemeier (1994), Distributed processing of a regional prediction model, Month. Weather Rev. 122,11, 2558–2572, DOI: 10.1175/1520-0493(1994)122〈2558:DPOARP〉 2.0.CO;2.
Juang, H.M.H., W.K. Tao, X. Zeng, C.L. Shie, S. Lang, and J. Simpson (2007), Parallelization of the NASA Goddard cumulus ensemble model for massively parallel computing, Terr. Atmos. Ocean. Sci. 18,3, 593–622, DOI: 10.3319/TAO.2007.18.3.593(A).
Miller, M.J., and P.K. Smolarkiewicz (2008), Preface: Predicting weather, climate and extreme events, J. Comput. Phys. 227,7, 3429–3430, DOI: 10.1016/j.jcp.2008.01.001.
Povitsky, A. (1999), Parallelization of pipelined algorithms for sets of linear banded systems, J. Parallel Dist. Com. 59, 68–97, DOI: 10.1006/jpdc.1999.1568.
Prusa, J.M., and P.K. Smolarkiewicz (2003), An all-scale anelastic model for geophysical flows: dynamic grid deformation, J. Comput. Phys. 190,2, 601–622, DOI: 10.1016/S0021-9991(03)00299-7.
Prusa, J.M., P.K. Smolarkiewicz, and A.A. Wyszogrodzki (1999), Parallel computation of gravity wave turbulence in the earth’s atmosphere, SIAM News 32,7, 10–13, http://www.siam.org/news/news.php?id=764.
Prusa, J.M., P.K. Smolarkiewicz, and A.A. Wyszogrodzki (2001), Simulations of gravity wave induced turbulence using 512 PE Cray T3E, Int. J. Appl. Math. Comput. Sci. 11,4, 883–897.
Prusa, J.M., P.K. Smolarkiewicz, and A.A. Wyszogrodzki (2008), EULAG, a computational model for multiscale flows, Comput. Fluids 37,9, 1193–1207, DOI: 10.1016/j.compfluid.2007.12.001.
Smolarkiewicz, P.K. (2006), Multidimensional positive definite advection transport algorithm: an overview, Int. J. Numer. Meth. Fluids 50,10, 1123–1144, DOI: 10.1002/fld.1071.
Smolarkiewicz, P.K., and L.G. Margolin (1993), On forward-in-time differencing for fluids: extension to a curvilinear framework, Month. Weather Rev. 121,6, 1847–1859, DOI: 10.1175/1520-0493(1993)121〈1847:OFITDF〉2.0.CO;2.
Smolarkiewicz, P.K., and L.G. Margolin (1994), Variational solver for elliptic problems in atmospheric flows, Int. J. Appl. Math. Comput. Sci. 4, 527–551.
Smolarkiewicz, P.K., and L.G. Margolin (2000), Variational methods for elliptic problems in fluid models. In: Proc. ECMWF Workshop on Developments in Numerical Methods for Very High Resolution Global Models, 5-7 June 2000, ECMWF, Reading, UK, 137–159.
Smolarkiewicz, P.K., and J.A. Pudykiewicz (1992), A class of semi-Lagrangian approximations for fluids, J. Atmos. Sci. 49,22, 2082–2096, DOI: 10.1175/1520-0469(1992)049〈2082:ACOSLA〉2.0.CO;2.
Smolarkiewicz, P.K., and J. Szmelter (2009), Iterated upwind schemes for gas dynamics, J. Comput. Phys. 228, 33–54, DOI: 10.1016/j.jcp.2008.08.008.
Smolarkiewicz, P.K., and J. Szmelter (2011), A nonhydrostatic unstructured-mesh soundproof model for simulation of internal gravity waves, Acta Geophys. 59,6, DOI: 10.2478/s11600-011-0048-7.
Smolarkiewicz, P.K., and C.L. Winter (2010), Pores resolving simulation of Darcy flows, J. Comput. Phys. 229,9, 3121–3133, DOI: 10.1016/j.jcp.2009.12.031.
Smolarkiewicz, P.K., L.G. Margolin, and A.A. Wyszogrodzki (2001), A class of nonhydrostatic global models, J. Atmos. Sci. 58,4, 349–364, DOI: 10.1175/1520-0469(2001)058〈0349:ACONGM〉2.0.CO;2.
Smolarkiewicz, P.K., C. Temperton, S.J. Thomas, and A.A. Wyszogrodzki (2004), Spectral preconditioners for nonhydrostatic atmospheric models: extreme applications. In: Proc. ECMWF Seminar Series on Recent Developments in Numerical Methods for Atmospheric and Ocean Modelling, ECMWF, Reading, UK, 203–220.
Stone, H.S. (1973), An efficient parallel algorithm for the solution of a tridiagonal linear system of equations, JACM 20, 27–38, DOI: 10.1145/321738.321741.
Strikwerda, J.C. (1989), Finite Difference Schemes and Partial Differential Equations, Wadsworth & Brooks, Mitchigan, 386 pp.
Thomas, S.J., J.P. Hacker, P.K. Smolarkiewicz, and R.B. Stull (2003), Spectral preconditioners for nonhydrostatic atmospheric models, Month. Weather Rev. 131,10, 2464–2478, DOI: 10.1175/1520-0493(2003)131〈2464:SPFNAM〉 2.0.CO;2.
Wyszogrodzki, A. (2008), Parallelization and Data Structure of EULAG, First EULAG Model User’s Workshop, 6–10 October 2008, Bad Tölz, Germany, http://www.mmm.ucar.edu/eulag/Workshop2008b.html.
Author information
Authors and Affiliations
Corresponding author
Additional information
On leave from the Institute of Meteorology and Water Management, Warsaw, Poland
Rights and permissions
About this article
Cite this article
Piotrowski, Z.P., Wyszogrodzki, A.A. & Smolarkiewicz, P.K. Towards petascale simulation of atmospheric circulations with soundproof equations. Acta Geophys. 59, 1294–1311 (2011). https://doi.org/10.2478/s11600-011-0049-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.2478/s11600-011-0049-6