Abstract
The use of large distributed computing infrastructures has become a fundamental component in most of scientific and technological projects. Due to its highly distributed nature, one of the key topics to be addressed in large distributed systems (like Grids and Federation of Clouds) is the determination of the availability and state of resources. Having up-to-date information about resources in the system is extremely important as this is consumed by the scheduler for selecting the appropriate target in each job to be served.
The way in which this information is obtained and distributed is what is known as Resource Information Distribution Policy. A centralized organization presents several drawbacks, for example, a single point of failure. Notwithstanding, the static hierarchy has become the defacto implementation of grid information systems.
There is a growing interest in the interaction with the Peer to Peer (P2P) paradigm, pushing towards scalable solutions. Super Peer Policy (SP) is a decentralized policy which presents a notable improvement in terms of response time and expected number of results compared with decentralization one. While Hierarchical policy is valuable for small and medium-sized Grids, SP is more effective in very large systems and therefore is more scalable.
In this work, we analyze SP focusing on the communication between super-peers. An improvement to the standard protocol is proposed which leads to two new SP policies outperforming the standard implementation: N-SP and A2A-SP. These policies are analyzed in terms of obtained performance in Exponential and Barabási network topologies, network consumption and scalability.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Albert, R., Jeong, H., Barabási, A.L.: Internet: diameter of the world-wide web. Nature 401, 130–131 (1999). http://adsabs.harvard.edu/abs/1999Natur.401.130A
Assunção, M.D., Calheiros, R.N., Bianchi, S., Netto, M.A., Buyya, R.: Big data computing and clouds: trends and future directions. J. Parallel Distrib. Comput. 79, 3–15 (2014). http://www.sciencedirect.com/science/article/pii/S0743731514001452, Special issue on Scalable Systems for Big Data Management and Analytics
Barabási, A.L., Albert, R.: Emergence of scaling in random networks. Science 286(5439), 509–512 (1999)
Casanova, H., Legrand, A., Quinson, M.: SimGrid: a generic framework for large-scale distributed experiments. In: 10th IEEE International Conference on Computer Modeling and Simulation, pp. 126–131. IEEE Computer Society, Los Alamitos, March 2008
Cesario, E., Mastroianni, C., Talia, D.: Distributed volunteer computing for solving ensemble learning problems. Future Gener. Comput. Syst. (2015, in press). http://www.sciencedirect.com/science/article/pii/S0167739X15002332
Ergu, D., Kou, G., Peng, Y., Shi, Y., Shi, Y.: The analytic hierarchy process: task scheduling and resource allocation in cloud computing environment. J. Supercomput. 64(3), 835–848 (2013)
Foster, I., Zhao, Y., Raicu, I., Lu, S.: Cloud computing and grid computing 360-degree compared. In: 2008 Grid Computing Environments Workshop, GCE 2008, pp. 1–10, November 2008
Foster, I., Kesselman, C.: The Grid 2: Blueprint for a New Computing Infrastructure. The Morgan Kaufmann Series in Computer Architecture and Design. Morgan Kaufmann Publishers Inc., San Francisco (2003)
Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid: enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl. 15(3), 200–222 (2001). http://portal.acm.org/citation.cfm?id=1080667
Ghafarian, T., Deldari, H., Javadi, B., Yaghmaee, M.H., Buyya, R.: Cycloidgrid: a proximity-aware P2P-based resource discovery architecture in volunteer computing systems. J. Future Gener. Comput. Syst. 29(6), 1583–1595 (2013). http://www.sciencedirect.com/science/article/pii/S0167739X12001665, Including Special sections: High Performance Computing in the Cloud & Resource Discovery Mechanisms for P2P Systems
Iamnitchi, A., Foster, I., Nurmi, D.: A peer-to-peer approach to resource discovery in grid environments. In: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing HPDC-11 (HPDC 2002), p. 419. IEEE, Edinbourgh, July 2002
Iamnitchi, A., Foster, I.: A peer-to-peer approach to resource location in Grid environments. In: Grid Resource Management: State of the Art and Future Trends, pp. 413–429. Kluwer Academic Publishers, Norwell (2004)
Karypis, G., Kumar, V.: A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20(1), 359–392 (1998)
Liu, W., Nishio, T., Shinkuma, R., Takahashi, T.: Adaptive resource discovery in mobile cloud computing. Comput. Commun. 50, 119–129 (2014). http://www.sciencedirect.com/science/article/pii/S0140366414000590, Green Networking
Márquez, D.G., Mocskos, E.E., Slezak, D.F., Turjanski, P.G.: Simulation of resource monitoring and discovery in grids. In: Proceedings of HPC 2010 High-Performance Computing Symposium, pp. 3258–3270 (2010). http://www.39jaiio.org.ar/node/121
Mastroianni, C., Talia, D., Verta, O.: A super-peer model for resource discovery services in large-scale Grids. Future Gener. Comput. Syst. 21(8), 1235–1248 (2005). http://www.sciencedirect.com/science/article/pii/S0167739X05000701
Mastroianni, C., Talia, D., Verta, O.: Designing an information system for Grids: comparing hierarchical, decentralized P2P and super-peer models. Parallel Comput. 34(10), 593–611 (2008)
Mattmann, C., Garcia, J., Krka, I., Popescu, D., Medvidovic, N.: Revisiting the anatomy and physiology of the grid. J. Grid Comput. 13(1), 19–34 (2015)
Mocskos, E.E., Yabo, P., Turjanski, P.G., Fernandez Slezak, D.: Grid matrix: a grid simulation tool to focus on the propagation of resource and monitoring information. Simul-T Soc. Mod. Sim. 88(10), 1233–1246 (2012)
Pipan, G.: Use of the TRIPOD overlay network for resource discovery. Future Gener. Comput. Syst. 26(8), 1257–1270 (2010). http://www.sciencedirect.com/science/article/pii/S0167739X1000018X
Plale, B., Jacobs, C., Jensen, S., Liu, Y., Moad, C., Parab, R., Vaidya, P.: Understanding Grid resource information management through a synthetic database benchmark/workload. In: CCGRID 2004: Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid, pp. 277–284. IEEE Computer Society, Washington, April 2004
Puppin, D., Moncelli, S., Baraglia, R., Tonellotto, N., Silvestri, F.: A grid information service based on peer-to-peer. In: Cunha, J.C., Medeiros, P.D. (eds.) Euro-Par 2005. LNCS, vol. 3648, pp. 454–464. Springer, Heidelberg (2005)
Ranjan, R., Harwood, A., Buyya, R.: Peer-to-peer-based resource discovery in global grids: a tutorial. IEEE Commun. Surv. Tut. 10(2), 6–33 (2008)
Ranjan, R., Zhao, L.: Peer-to-peer service provisioning in cloud computing environments. J Supercomput. 65(1), 154–184 (2013)
Ripeanu, M.: Peer-to-peer architecture case study: Gnutella network. In: 2001 Proceedings of the First International Conference on Peer-to-Peer Computing, pp. 99–100, August 2001
Shiers, J.: The worldwide LHC computing grid (worldwide LCG). Comput. Phys. Commun. 177(1–2), 219–223 (2007)
Trunfio, P., Talia, D., Papadakis, C., Fragopoulou, P., Mordacchini, M., Pennanen, M., Popov, K., Vlassov, V., Haridi, S.: Peer-to-Peer resource discovery in Grids: models and systems. Future Gener. Comput. Syst. 23(7), 864–878 (2007)
Williams, D.N., Drach, R., Ananthakrishnan, R., Foster, I., Fraser, D., Siebenlist, F., Bernholdt, D., Chen, M., Schwidder, J., Bharathi, S., et al.: The earth system grid: enabling access to multimodel climate simulation data. Bull. Am. Meteorol. Soc. 90(2), 195–205 (2009)
Acknowledgments
E.M. is researcher of the CONICET. This work was partially supported by grants from Universidad de Buenos Aires (UBACyT 20020130200096BA) and CONICET (PIP 11220110100379).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Verghelet, P., Mocskos, E. (2015). Improvements to Super-Peer Policy Communication Mechanisms. In: Osthoff, C., Navaux, P., Barrios Hernandez, C., Silva Dias, P. (eds) High Performance Computing. CARLA 2015. Communications in Computer and Information Science, vol 565. Springer, Cham. https://doi.org/10.1007/978-3-319-26928-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-26928-3_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26927-6
Online ISBN: 978-3-319-26928-3
eBook Packages: Computer ScienceComputer Science (R0)