Skip to main content

The Design of Seamless MPI Computing Environment for Commodity-Based Clusters

  • Conference paper
Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI 2009)

Abstract

This paper describes the design and implementation of a seamless MPI runtime environment, called MPI-Adapter, that realizes MPI program binary portability in different MPI runtime environments. MPI-Adapter enables an MPI binary program to run on different MPI implementations. It is implemented as a dynamic loadable module so that the module dynamically captures all MPI function calls and invokes functions defined in a different MPI implementation using the data type translation techniques. A prototype system was implemented for Linux PC clusters to evaluate the effectiveness of MPI-Adapter. The results of an evaluation on a Xeon Processor (3.8GHz) based cluster show that the MPI translation overhead of MPI sending (receiving) is around 0.028μs, and the performance degradation of MPI-Adapter is negligibly small on the NAS parallel benchmark IS.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T2K Open Supercomputer Alliance, http://www.open-supercomputer.org/

  2. GSIC, http://www.gsic.titech.ac.jp/index.html.en

  3. RSCC: RIKEN Super Combined Cluster System, http://w3cic.riken.go.jp/rscc/

  4. Super Computer TOP500, http://www.top500.org/

  5. The Message Passing Interface (MPI) standard, http://www.mpi-forum.org/docs/docs.html

  6. The Message Passing Interface (MPI) Forum, http://www.mpi-forum.org

  7. OpenMPI, http://www.open-mpi.org/

  8. MPICH2, http://www.mcs.anl.gov/research/projects/mpich2/

  9. MPI ABI OpenMPI + MPICH2 + HPMPI + LAMPI + NEC + vendors.xls, https://svn.mpi-forum.org/trac/mpi-forum-web/attachment/wiki/abiwikipage/mpi%20abi%20openmpi%20%2b%20mpich2%20%2b%20hpmpi%20%2b%20lampi%%20%2b%20nec%20%2b%20vendors.xls

    Google Scholar 

  10. SCore Cluster System Software, http://www.pccluster.org/

  11. Sumimoto, S., Ooe, K., Kumon, K., Boku, T., Sato, M., Ukawa, A.: A Scalable Communication Layer for Multi-Dimensional Hyper Crossbar Network Using Multiple Gigabit Ethernet. In: The International Conference on Supercomputing 2006 (ICS 2006). ACM Press, New York (2006)

    Google Scholar 

  12. MorphMPI, http://morphmpi.sourceforge.net/

  13. Gropp, W.: Building library components that can use any mpi implementation. In: Kranzlmüller, D., Kacsuk, P., Dongarra, J., Volkert, J. (eds.) PVM/MPI 2002. LNCS, vol. 2474, pp. 280–287. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  14. Application Binary Interface Working Group, https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/abiwikipage

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sumimoto, S. et al. (2009). The Design of Seamless MPI Computing Environment for Commodity-Based Clusters. In: Ropo, M., Westerholm, J., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2009. Lecture Notes in Computer Science, vol 5759. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03770-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03770-2_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03769-6

  • Online ISBN: 978-3-642-03770-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics