Skip to main content
SpringerLink
Log in

Using a Simple Prioritisation Mechanism to Effectively Interoperate Service and Opportunistic Grids in the EELA-2 e-Infrastructure

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Grids currently in production can be broadly classified as either service Grids, composed of dedicated resources, or opportunistic Grids that harvest the computing power of non-dedicated resources when they are idle. While a service Grid provides high and well defined levels of quality of service, an opportunistic Grid provides only a best-effort service. Nevertheless, since opportunistic Grids do not require resources to be fully dedicated to the Grid, they have the potential to assemble a much larger number of resources. Moreover, these Grids cater very well to the execution of the so-called embarrassingly parallel applications, a type of application that is frequently found in practice, and that comprises the largest portion of the typical workload processed in production Grid systems. The EELA-2 e-infrastructure is comprised of a service Grid and an opportunistic Grid that federates computing resources from scientific institutions in both Europe and Latin America. Due to the complementary characteristics of these two types of Grids, a lot of attention has recently been placed in how to interoperate them. In this paper we focus on the less studied problem of assessing the feasibility of such interoperation. We analyse different prioritisation policies that define when the resources of one Grid can be used to run jobs originating from the other. Our results show that in the absence of a suitable prioritisation policy, the benefits that the users of one Grid may have, frequently come with an important negative impact on the users of the other Grid. We also show that a simple reciprocation mechanism is capable of arbitrating the interoperation in such a way that, whenever possible, users profit from the interoperation and, in no case, this benefit leads to a noticeable reduction on the quality of service that the users would experience were the Grids not to interoperate. We conclude discussing how we have implemented, in the context of the EELA-2 project, this prioritisation mechanism, allowing the effective interoperation of a service Grid based on the gLite middleware with an opportunistic Grid that uses the OurGrid middleware.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Anderson, D.P., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: an experiment in public-resource computing. Commun. ACM, 45(11), 56–61 (2002)

    Article  Google Scholar 

  2. Anderson, D.P.: BOINC: a system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, GRID ’04, pp. 4–10. IEEE Computer Society, Washington, DC, USA (2004)

    Chapter  Google Scholar 

  3. Andrade, N., Brasileiro, F., Cirne, W., Mowbray, M.: Automatic Grid assembly by promoting collaboration in peer-to-peer Grids. J. Parallel Distrib. Comput. 67(8), 957–966 (2007)

    Article  MATH  Google Scholar 

  4. Anglano, C., Canonico, M., Guazzone, M.: The ShareGrid peer-to-peer desktop Grid: infrastructure, applications, and performance evaluation. J. Grid Computing 8(4), 543–570 (2010). doi:10.1007/s10723-010-9162-z

    Article  Google Scholar 

  5. Brochu, F., Egede, U., Elmsheuser, J., Harrison, K., Jones, R.W.L., Lee, H.C., Liko, D., Maier, A., Moscicki, J.T., Muraru, A., Patrick, G.N., Pajchel, K., Reece, W., Samset, B.H., Slater, M.W., Soroko, A., Tan, C.L., Vanderster, D.C.: Ganga: a tool for computational-task management and easy access to Grid resources. CoRR. abs/0902.2685 (2009)

  6. Cirne, W., Brasileiro, F., Andrade, N., Costa, L., Andrade, A., Novaes, R., Mowbray, M.: Labs of the world, unite!!! J. Grid Computing 4(3), 225–246 (2006)

    Article  MATH  Google Scholar 

  7. da Silva, D.P, Cirne, W, Brasileiro, F.: Trading cycles for information: using replication to schedule bag-of-tasks applications on computational Grids. In: Proceedings of the Euro-Par 2003: International Conference on Parallel and Distributed Computing, pp. 169–180. Klagenfurt, Austria (2003)

    Google Scholar 

  8. de Barros, A.G., Furtado, A.A., Brasileiro, F.: Bridging OurGrid-based and gLite-based Grid infrastructures. In: Proceedings of the Second EELA-2 Conference (2009)

  9. Epema, D.H.J., Livny, M., van Dantzig, R., Evers, X., Pruyne, J.: A worldwide flock of condors: load sharing among workstation clusters. Future Gener. Comput. Syst. 12(1), 53–65 (1996)

    Article  Google Scholar 

  10. Estrada, T., Taufer, M., Anderson, D.: Performance prediction and analysis of BOINC projects: an empirical study with EmBOINC. J. Grid Computing 7, 537–554 (2009) doi:10.1007/s10723-009-9126-3

    Article  Google Scholar 

  11. Farkas, Z., Kacsuk, P., Balaton, Z., Gombás, G.: Interoperability of BOINC and EGEE. Future Gener. Comput. Syst. 26(8), 1092–1103 (2010)

    Article  Google Scholar 

  12. Field, L., Laure, E., Schulz, M.: Grid deployment experiences: Grid interoperation. J. Grid Computing 7, 287–296 (2009) doi:10.1007/s10723-009-9128-1

    Article  Google Scholar 

  13. Flechl, M., Field, L.: Grid interoperability: joining Grid information systems. J. Phys. Conf. Ser. 119(6), 062030 (2008)

    Article  Google Scholar 

  14. Gagliardi, F., Jones, B., Grey, F., Bégin, M.-E., Heikkurinen, M.: Building an infrastructure for scientific Grid computing: status and goals of the egee project. Philos. Trans. R. Soc. Lond. A: Math. Phys. Eng. Sci. 363(1833), 1729–1742 (2005)

    Article  Google Scholar 

  15. Hernández, V., Blanquer, I., Aparicio, G., Isea, R., Chaves, J.L., Hernández, Á., Mora, H.R., Fernández, M., Acero, A., Montes, E., Mayo, R.: Advances in the biomedical applications of the EELA project. Stud. Health Technol. Inform. 126, 31–36 (2007)

    Google Scholar 

  16. Iosup, A., Li, H., Jan, M., Anoep, S., Dumitrescu, C., Wolters, L., Epema, D.H.J.: The Grid workloads archive. Future Gener. Comput. Syst. 24(7), 672–686 (2008)

    Article  Google Scholar 

  17. Kacsuk, P., Kiss, T., Sipos, G.: Solving the Grid interoperability problem by P-GRADE portal at workflow level. Future Gener. Comput. Syst. 24(7), 744–751 (2008)

    Article  Google Scholar 

  18. Litzkow, M., Livny, M., Mutka, M.: Condor—a hunter of idle workstations. In: Proceedings of the 8th International Conference of Distributed Computing Systems, pp. 104–111. IEEE Computer Society, San Jose, CA, USA (1988)

    Google Scholar 

  19. Marechal, B., Bello, P.H.R., Carvalho, D.: Building a Grid in latin america: the EELA project e-infrastructure. In: CCGRID ’07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pp. 835–839. IEEE Computer Society, Washington, DC, USA (2007)

    Chapter  Google Scholar 

  20. Marechal, B., Bello, P.R., Carvalho, D., Mayo, R.: Applications ported to the EELA e-infrastructure. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid’07), pp. 852–857. IEEE Computer Society, Washington, DC, USA (2007)

    Chapter  Google Scholar 

  21. Marzolla, M., Andreetto, P., Venturi, V., Ferraro, A., Memon, A.S., Memon, M.S., Twedell, B., Riedel, M., Mallmann, D., Streit, A., van de Berghe, S., Li, V., Snelling, D., Stamou, K., Shah, Z.A., Hedman, F.: Open standards-based interoperability of job submission and management interfaces across the Grid middleware platforms gLite and UNICORE. In: Proceedings of International Interoperability and Interoperation Workshop (IGIIW) 2007 at 3rd IEEE International Conference on e-Science and Grid Computing, pp. 592–599. IEEE Computer Society, Bangalore, India (2007)

    Google Scholar 

  22. Riedel, M., Memon, A.S., Memon, M.S., Mallmann, D., Streit, A., Wolf, F., Lippert, Th., Venturi, V., Andreetto, P., Marzolla, M., Ferraro, A., Ghiselli, A., Hedman, F., Shah, Z.A., Salzemann, J., Da Costa, A., Breton, V., Kasam, V., Hofmann-Apitius, M., Snelling, D., van de Berghe, S., Li, V., Brewer, S., Dunlop, A., De Silva, N.: Improving e-science with interoperability of the e-infrastructures EGEE and DEISA. In: Proceedings of the 31st International Convention MIPRO, Conference on Grid and Visualization Systems (GVS), pp. 225–231. Opatija, Croatia, Croatian Society for Information and Communication Technology, Electronics and Microelectronics (2008)

  23. Santos, R., Andrade, A., Cirne, W., Brasileiro, F., Andrade, N.: Relative autonomous accounting for peer-to-peer Grids: research articles. Concurr. Comput.: Pract. Exp. 19, 1937–1954 (2007)

    Article  Google Scholar 

  24. Urbah, E., Kacsuk, P., Farkas, Z., Fedak, G., Kecskemeti, G., Lodygensky, O., Marosi, A., Balaton, Z., Caillat, G., Gombas, G., Kornafeld, A., Kovacs, J., He, H., Lovas, R.: EDGeS: bridging EGEE to BOINC and XtremWeb. J. Grid Computing 7, 335–354 (2009). doi:10.1007/s10723-009-9137-0

    Article  Google Scholar 

  25. Vadhiyar, S.S., Dongarra, J.J.: A metascheduler for the Grid. In: HPDC ’02: Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, p. 343. IEEE Computer Society, Washington, DC, USA (2002)

    Chapter  Google Scholar 

  26. Vázquez-Poletti, J.L., Huedo, E., Montero, R.S., Llorente, I.M.: Coordinated harnessing of the IRISgrid and EGEE testbeds with gridway. J. Parallel Distrib. Comput. 66(5), 763–771 (2006)

    Article  Google Scholar 

  27. Wang, Y., Scardaci, D., Yan, B., Huang, Y.: Interconnect EGEE and CNGRID e-infrastructures through interoperability between gLite and GOS middlewares. In: Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing (e-Science’07)—International Grid Interoperability and Interoperation Workshop. IEEE Computer Society, Los Alamitos, CA, USA (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidade Federal de Campina Grande, Av. Aprígio Veloso, s/n, 58.429-900, Campina Grande, PB, Brazil

    Francisco Brasileiro, Matheus Gaudencio, Rafael Silva & Alexandre Duarte

  2. Centro Federal de Educação Tecnológica Celso Suckow da Fonseca, Av. Maracanã 229, 20271-110, Rio de Janeiro, RJ, Brazil

    Diego Carvalho

  3. Universidad de Los Andes, CeCalCULA, Av. 4, Edif. General Masini, Piso 3, Mérida, 5101, Venezuela

    Herbert Hoeger

  4. Rede Nacional de Ensino e Pesquisa, R. Lauro Müller 116 / 1103, 22290-906, Rio de Janeiro, RJ, Brazil

    Leandro Ciuffo & Michael Stanton

  5. Universidade Federal Fluminende, R. Lauro Müller 116 / 1103, 22290-906, Rio de Janeiro, RJ, Brazil

    Michael Stanton

  6. Istituto Nazionale di Fisica Nucleare, Sezione di Catania, Via S. Sofia, 64, 95123, Catania, Italy

    Diego Scardaci

  7. Dipartimento di Fisica e Astronomia dell’Universitá di Catania, Via S. Sofia, 64, 95123, Catania, Italy

    Roberto Barbera

  8. INFN, Via S. Sofia, 64, 95123, Catania, Italy

    Roberto Barbera

  9. CIEMAT, Avda. Complutense, 22, 28040, Madrid, Spain

    Rafael Mayo

  10. CETA-CIEMAT, C/ Sola, 1, 10200, Trujillo, Spain

    Raul Ramos, Bernard Marechal & Philippe Gavillet

  11. CERN, C/ Sola, 1, 10200, Trujillo, Spain

    Bernard Marechal & Philippe Gavillet

Authors
  1. Francisco Brasileiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matheus Gaudencio
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rafael Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexandre Duarte
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Diego Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Diego Scardaci
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Leandro Ciuffo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Rafael Mayo
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Herbert Hoeger
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Michael Stanton
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Raul Ramos
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Roberto Barbera
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Bernard Marechal
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Philippe Gavillet
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francisco Brasileiro.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Brasileiro, F., Gaudencio, M., Silva, R. et al. Using a Simple Prioritisation Mechanism to Effectively Interoperate Service and Opportunistic Grids in the EELA-2 e-Infrastructure. J Grid Computing 9, 241–257 (2011). https://doi.org/10.1007/s10723-010-9177-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-010-9177-5

Keywords

Search

Navigation