Abstract
For high performance parallel computing on actual Grids, one of the important issues is to co-allocate the distributed resources that are managed by various local schedulers with advance reservation. To address the issue, we proposed and developed the GridARS resource co-allocation framework, and a general advance reservation protocol that uses WSRF/GSI and a two-phased commit (2PC) protocol to enable a generic and secure advance reservation process based on distributed transactions, and provides the interface module for various existing resource schedulers. To confirm the effectiveness of GridARS, we describe the performance of a simultaneous reservation process and a case study of GridARS grid co-allocation over transpacific computing and network resources. Our experiments showed that: 1) the GridARS simultaneous 2PC reservation process is scalable and practical and 2) GridARS can co-allocate distributed resources managed by various local schedulers stably.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
TeraGrid, http://www.teragrid.org/
OASIS Web Services Resource Framework (WSRF) TC: Web Services Resource 1.2 (WS-Resource) Committee Specification (2006)
Foster, I.: Globus Toolkit Version 4: Software for Service-Oriented Systems. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 2–13. Springer, Heidelberg (2005)
Moab Grid Scheduler (Silver) Administrator’s Guide, version 4.0, http://www.clusterresources.com/products/mgs/docs/
Community Scheduler Framework, http://sf.net/projects/gcsf
Grid Engine, http://gridengine.sunsource.net/
TORQUE Resource Manager, http://www.clusterresources.com/resource-manager.php
Ganglia Monitoring System, http://ganglia.info/
OASIS Web Services Notification (WSN) TC: Web Services Base Notification 1.3 (WS-BaseNotification) Public Review Draft 02 (2005)
Anjomshoaa, A., Brisard, F., Drescher, M., Fellows, D., Ly, A., McGough, S., Pulsipher, D., Savva, A.: Job Submission Description Language (JSDL) Specification v1.0 (2005)
Takefusa, A., Hayashi, M., Nagatsu, N., Nakada, H., Kudoh, T., Miyamoto, T., Otani, T., Tanaka, H., Suzuki, M., Sameshima, Y., Imajuku, W., Jinno, M., Takigawa, Y., Okamoto, S., Tanaka, Y., Sekiguchi, S.: G-lambda: Coordination of a Grid Scheduler and Lambda Path Service over GMPLS. Future Generation Computing Systems 22(2006), 868–875 (2006)
Takefusa, A., Hayashi, M., Hirano, A., Okamoto, S., Kudoh, T., Miyamoto, T., Tsukishima, Y., Otani, T., Nakada, H., Tanaka, H., Taniguchi, A., Sameshima, Y.: GNS-WSI2 Grid Network Service - Web Services Interface, version 2, OGF19, GHPN-RG (2007)
The G-lambda project, http://www.g-lambda.net/
Thorpe, S.R., Battestilli, L., Karmous-Edwards, G., Hutanu, A., MacLaren, J., Mambretti, J., Moore, J.H., Sundar, K.S., Xin, Y., Takefusa, A., Hayashi, M., Hirano, A., Okamoto, S., Kudoh, T., Miyamoto, T., Tsukishima, Y., Otani, T., Nakada, H., Tanaka, H., Taniguchi, A., Sameshima, Y., Jinno, M.: G-lambda and EnLIGHTened: Wrapped In Middleware Co-allocating Compute and Network Resources Accross Japan and the US. In: Proc. GridNets (to appear, 2007)
GLIF: Global Lambda Integrated Facility, http://www.glif.is/
The EnLIGHTened Computing project, http://enlightenedcomputing.org/
GridMPI, http://www.gridmpi.org/
Ogata, S., Shimo, F., Kalia, R., Nakano, A., Vashisha, P.: Hybrid Quantum Mechanical/Molecular Dynamics Simulations on Parallel Computers: Density Functional Theory on Real-space Multigrids. Computer Physics Communications, p. 30
Nakada, H., Takefusa, A., Ookubo, K., Kishimoto, M., Kudoh, T., Tanaka, Y., Sekiguchi, S.: Design and Implementation of a Local Scheduling System with Advance Reservation for Co-allocation on the Grid. In: Proc. CIT 2006 (2006)
Maui Cluster Scheduler, http://www.clusterresources.com/pages/products/maui-cluster-scheduler.php
HARC: The Highly-Available Robust Co-allocator, http://www.cct.lsu.edu/~maclaren/HARC/
Zhou, S.: LSF: Load sharing in large-scale heterogeneous distributed systems. In: Proc. Workshop on Cluster Computing (1992)
OpenPBS, http://www.openpbs.org/
Yoshimoto, K., Kovatch, P., Andrews, P.: Co-scheduling with User-Settable Reservations. In: Feitelson, D.G., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2005. LNCS, vol. 3834, pp. 146–156. Springer, Heidelberg (2005)
Barz, C., Pilz, M., Eickermann, T., Kirtchakova, L., Waldrich, O., Ziegler, W.: Co-Allocation of Compute and Network Resources in the VIOLA Testbed, TR-0051, CoreGrid (2006)
UNICORE, http://www.kfa-juelich.de/unicore/
Andrieux, A., Czajkowski, K., Dan, A., Keathey, K., Ludwig, H., Nakata, T., Pruyne, J., Rofrano, J., Tuecke, S., Xu, M.: Web Services Agreement Specification (WS-Agreement) (2005), https://forge.gridforum.org/sf/docman/do/downloadDocument/projects.graap-wg/docman.root.current_drafts/doc6090
Gray, J., Lamport, L.: Consensus on Transaction Commit, MSR-TR-2003-96, Microsoft Research (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Takefusa, A., Nakada, H., Kudoh, T., Tanaka, Y., Sekiguchi, S. (2008). GridARS: An Advance Reservation-Based Grid Co-allocation Framework for Distributed Computing and Network Resources. In: Frachtenberg, E., Schwiegelshohn, U. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP 2007. Lecture Notes in Computer Science, vol 4942. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78699-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-78699-3_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78698-6
Online ISBN: 978-3-540-78699-3
eBook Packages: Computer ScienceComputer Science (R0)