Skip to main content
SpringerLink
Log in

Parallel Multigrid Solvers Using OpenMP/MPI Hybrid Programming Models on Multi-Core/Multi-Socket Clusters

  • Conference paper
High Performance Computing for Computational Science – VECPAR 2010 (VECPAR 2010)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6449))

Abstract

OpenMP/MPI hybrid parallel programming models were implemented to 3D finite-volume based simulation code for groundwater flow problems through heterogeneous porous media using parallel iterative solvers with multigrid preconditioning. Performance and robustness of the developed code has been evaluated on the “T2K Open Supercomputer (Tokyo)” and “Cray-XT4” using up to 1,024 cores through both of weak and strong scaling computations. OpenMP/MPI hybrid parallel programming model demonstrated better performance and robustness than flat MPI with large number of cores for ill-conditioned problems with appropriate command lines for NUMA control, first touch data placement and reordering of the data for contiguous “sequential” access to memory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nakajima, K.: Flat MPI vs. Hybrid: Evaluation of Parallel Programming Models for Preconditioned Iterative Solvers on “T2K Open Supercomputer”. In: IEEE Proceedings of the 38th International Conference on Parallel Processing (ICPP 2009), pp. 73–80 (2009)

    Google Scholar 

  2. Information Technology Center, The University of Tokyo, http://www.cc.u-tokyo.ac.jp/

  3. Nakajima, K.: Parallel Multilevel Method for Heterogeneous Field. In: IPSJ Proceedings of HPCS 2006, pp. 95–102 (2006) (in Japanese)

    Google Scholar 

  4. NERSC, Lawrence Berkeley National Laboratory, http://www.nersc.gov/

  5. The T2K Open Supercomputer Alliance, http://www.open-supercomputer.org/

  6. Deutsch, C.V., Journel, A.G.: GSLIB Geostatistical Software Library and User’s Guide, 2nd edn. Oxford University Press, Oxford (1998)

    Google Scholar 

  7. Tottemberg, U., Oosterlee, C., Schuller, A.: Multigrid. Academic Press, London (2001)

    Google Scholar 

  8. Nakajima, K.: Parallel Multilevel Iterative Linear Solvers with Unstructured Adaptive Grids for Simulations in Earth Science. Concurrency and Computation: Practice and Experience 14-6/7, 484–498 (2002)

    MATH  Google Scholar 

  9. Smith, B., Bjφrstad, P., Gropp, W.: Domain Decomposition, Parallel Multilevel Methods for Elliptic Partial Differential Equations. Cambridge Press, Cambridge (1996)

    Google Scholar 

  10. Mattson, T.G., Sanders, B.A., Massingill, B.L.: Patterns for Parallel Programming. Software Patterns Series (SPS). Addison-Wesley, Reading (2005)

    MATH  Google Scholar 

  11. Washio, T., Maruyama, K., Osoda, T., Shimizu, F., Doi, S.: Efficient implementations of block sparse matrix operations on shared memory vector machines. In: Proceedings of The 4th International Conference on Supercomputing in Nuclear Applications (SNA 2000) (2000)

    Google Scholar 

  12. STREAM (Sustainable Memory Bandwidth in High Performance Computers), http://www.cs.virginia.edu/stream/

Download references

Author information

Authors and Affiliations

  1. Information Technology Center, The University of Tokyo, 2-11-16 Yayoi, Bunko-ku, Tokyo, 113-8658, Japan

    Kengo Nakajima

Authors
  1. Kengo Nakajima
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculdade de Engenharia da, Universidade do Porto, Rua Dr. Roberto Frias s/n, 4200-465, Porto, Portugal

    José M. Laginha M. Palma

  2. INP (ENSEEIHT) IRIT, University of Toulouse, rue Charles-Camichel, CEDEX 7, 31071, Toulouse, France

    Michel Daydé

  3. Lawrence Berkeley National Laboratory, Berkeley, USA

    Osni Marques

  4. Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal

    João Correia Lopes

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nakajima, K. (2011). Parallel Multigrid Solvers Using OpenMP/MPI Hybrid Programming Models on Multi-Core/Multi-Socket Clusters. In: Palma, J.M.L.M., Daydé, M., Marques, O., Lopes, J.C. (eds) High Performance Computing for Computational Science – VECPAR 2010. VECPAR 2010. Lecture Notes in Computer Science, vol 6449. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19328-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19328-6_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19327-9

  • Online ISBN: 978-3-642-19328-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation