Abstract
In many Grid infrastructures different kinds of information services are in use, which utilize different incompatible data structures and interfaces to encode and provide their data. Homogeneous monitoring of these infrastructures with the monitoring data being accessible everywhere independently of the middleware which provided it, is the basis for a consistent status reporting on the Grids’ resources and services. Thus, interoperability or interoperation between the different information services in a heterogeneous Grid infrastructure is required. Monitoring data must contain the identity of the affected Virtual Organization (VO) so that it can be related to the resources and services the VO has allocated to enable VO-specific information provision. This paper describes a distributed architecture for an interoperable information service, which combines data unification and categorization with policies for VO membership, VO resource management and data transformations. This service builds the basis for an integrated and interoperating monitoring of Grids, which provide their data to more than one VO and utilize heterogeneous information services.
Article PDF
Similar content being viewed by others
References
Värttö, S. (ed.): DEISA Advancing Science in Europe. www.deisa.eu, http://www.deisa.eu/press/Media (2008)
Appleton, O., Cook, A., Hämmerle, H.: EGEE in 2007. www.eu-egee.org, http://press.eu-egee.org/fileadmin/documents/publications/EGEEin2007-final.pdf (2008)
TeraGrid: Open scientific discovery infrastructure. http://www.teragrid.org/. Accessed September 2008
Neuroth, A., Kerzel, M., Gentzsch, W. (eds.): German Grid Initiative D-Grid. Universitätsverlag Göttingen (2007)
Ellert, M., Gronager, M., Konstantinov, A., Konya, B., Lindemann, J., Livenson, I., Nielsen, J., Niinimaki, M., Smirnova, O., Waananen, A.: Advanced Resource Connector middleware for lightweight computational Grids. Future Gener. Comput. Syst. 23(2), 219–240 (2007)
D-MON Project: Horizontal integration of resource- and service monitoring in d-Grid. http://www.d-grid.de/index.php?id=401&L=1. Accessed September 2008
Alef, M., Fieseler, T., Freitag, S., Garcia, A., Grimm, C., Gürich, W., Mehammed, H., Schley, L., Schneider, O., Volpato, G.: Integration of Multiple Middlewares on a Single Computing Resource. Future Generation Computer Systems (2008). Accessed May 2008
Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R.: A Grid Monitoring Architecture. Tech. Rep. GDF.7, Global Grid Forum (2002)
Schopf, J., Raicu, I., Perlman, L., Miller, N., Kesselman, C., Foster, I., D’Arcy, M.: Monitoring and discovery in a web services framework: functionality and performance of Globus Toolkit MDS4. In: Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing. IEEE Computer Society, Los Alamitos (2006)
Cooke, A., Gray, A.J.G., Ma, L., Nutt, W., Magowan, J., Oevers, M., Taylor, P., Byrom, R., Field, L., Hicks, S., Leake, J., Soni, M., Wilson, A., Cordenonsi, R., Cornwall, L., Djaoui, A., Fisher, S., Podhorszki, N., Coghlan, B., Kenny, S., OrsquoCallaghan, D.: R-GMA: An information integration system for Grid monitoring. In: On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE. LNCS, vol. 2888, pp. 462–481. Springer, New York (2003)
Foster, I., Maguire, T., Snelling, D.: OGSA WSRF Basic Profile 1.0. Tech. Rep. GDF.72, Global Grid Forum (2006)
Foster, I.: Globus Toolkit Version 4: software for service-oriented systems. In: IFIP International Conference on Network and Parallel Computing. LNCS, no. 3779, pp. 2–13. Springer, New York (2006)
gLite: Lightweight Middleware for Grid Computing. http://glite.web.cern.ch/glite/. Accessed September 2008
Marzolla, M., Andreetto, P., Venturi, V., Ferraro, A., Memon, A.S., Memon, M.S., Twedell, B., Riedel, M., Mallmann, D., Streit, A., van de Berghe, S., Li, V., Snelling, D., Stamou, K., Shah, Z.A., Hedman, F.: Open standards-based interoperability of job submission and management interfaces across the Grid middleware platforms gLite and UNICORE. In: E-SCIENCE ’07: Proceedings of the Third IEEE International Conference on e-Science and Grid Computing, pp. 592–601. IEEE Computer Society, Washington, DC (2007). doi:10.1109/E-SCIENCE.2007.54
Hegering, H.G., Abeck, S., Neumair, B.: Integrated Management of Networked Systems: Concepts, Architectures, and Their Operational Application. Morgan Kaufmann, San Francisco (1999)
Adreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J. (ed.): GLUE 2.0 Specification V2.0. Tech. rep., Global Grid Forum (2008)
EDG: European Data Grid Project. http://eu-datagrid.web.cern.ch/. Accessed October 2008
DataTAG: Research & Technological Development for a Data TransAtlantic Grid. http://datatag.web.cern.ch/. Accessed October 2008
iVDGL: International Virtual Data Grid Laboratory. http://igoc.ivdgl.indiana.edu/. Accessed October 2008
LCG: Worldwide LHC Computing Grid. http://lcg.web.cern.ch/LCG/. Accessed October 2008
OSG: Open Science Grid. http://www.opensciencegrid.org/. Accessed October 2008
OGF: Open Grid Forum. http://www.ogf.org. Accessed October 2008
Mach, R., Lepro-Metz, R., Jackson, S.: Usage Record Format Recommendation. Tech. rep., Open Grid Forum (2006)
Wolf, A.: Spezifikation der D-Grid-Ressourcenbeschreibungssprache DGRDL. Tech. rep., Fraunhofer FIRST (2007)
Chem, X., Khan, A., Ainsworth, J., Newhouse, S., MacLaren, J.: WSI Resource Usage Service (RUS) Core Specification. Tech. rep., Open Grid Forum (2007)
Fielding, R.: Architectural styles and the design of network-based software architectures. Ph.D. Thesis, University of California, IRVINE (2000)
Baur, T., Saad, S.: Customer service management for grid monitoring and accounting data. In: Proceedings of the 18th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management (DSOM 2007). Springer, New York (2007)
Baur, T.: Functional analysis and architecture for interoperable and DVO-̈specific Grid monitoring services. In: Proceedings of the Fourth IEEE International Conference on eScience (eScience 2008). IEEE Computer Society, Los Alamitos (2008)
UNICORE: Uniform Interface to Computer Resources. http://www.unicore.eu/. Accessed September 2008
Fuhrmann, P.: dCache, the Overview. http://www.dcache.org/manuals/dcache-whitepaper-light.pdf. Accessed September 2008. White Paper
Antonioletti, M., Atkinson, M.P., Baxter, R., Borley, A., Hong, N.C., Collins, B., Hardman, N., Hume, A., Knox, A., Jackson, M., Krause, A., Laws, S., Magowan, J., Paton, N., Pearson, D., Sugden, T., Watson, P., Westhead, M.: The Design and Implementation of Grid Database Services in OGSA-DAI. Concurrency and Computation: Practice and Experience 17(2–4), 357–376 (2005)
Schopf, J.M., Pearlman, L., Miller, N., Kesselman, C., Foster, I., D’Arcy, M., Chervenak, A.: Monitoring the grid with the Globus Toolkit MDS4. Journal of Physics Conference Series 46, 521–525 (2006). doi:10.1088/1742-6596/46/1/072
Duarte, A., Nyczyk, P., Retico, A., Vicinanza, D.: Monitoring the EGEE/WLCG grid services. Journal of Physics: Conference Series 119(5), 052,014 (10pp) (2008). http://stacks.iop.org/1742-6596/119/052014
Memon, A.S., Memon, M.S., Wieder, P., Schuller, B.: CIS: An Information Service based on the Common Information Model. In: Proceedings of 3rd IEEE International Conference on e-Science and Grid Computing, pp. 465–472. IEEE Computer Society, Los Alamitos (2007)
Felde, V.D.G.O., Baur, T., Garschhammer, M., Reiser, H.: Anforderungen an das monitoring, ergebnisse aus der erhebung bei den communties und ressourcenanbietern im D-Grid. In: Rückemann, C.-P. (ed.) Ergebnisse der Studie und Anforde- rungsanalyse in den Fachgebieten Monitoring, Accounting, Billing bei den Communities und Ressourcenanbietern im D-Grid (D-Grid Report). http://www.d-grid.de/fileadmin/dgi_document/FG2/koordination_mab/mab_studie_ergebnisse.pdf (2006). Accessed October 2008
Baur, T., Felde, V.D.G.O., Reiser, H.: Konzepte zum Monitoring im D-Grid (D-Grid Report). http://www.d-grid.de/uploads/media/mab_monitoring_konzepte.pdf (2007). Accessed October 2008
Kunze, M., Pogoshyan, G.: Monitoring for multi-middleware grid. In: IEEE International Symposium on Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE Computer Society, Los Alamitos (2008)
Simmhan, Y.L., Plale, B., Gannon, D.: A Survey of Data Provenance Techniques. Tech. Rep. TR-618, Computer Science Department, Indiana University, Bloomington (2005)
Berry, D., Luniewski, A., Antonioletti, M.: OGSA Data Architecture. Tech. Rep. GDF.121, Global Grid Forum (2007)
Baur, T., Kalman, T., Lindinger, T., Milbert, A., Poghosyan, G., Romberg, M.: Middleware-übergreifendes Monitoring: Evaluierung und Auswahl von Komponenten (D-Grid Report). http://www.d-grid.de/fileadmin/user_upload/documents/D-MON/Komponenten-AP2.1-final.pdf. Accessed September 2008
Chaudhuri, S., Dayal, U.: Data warehousing and OLAP for decision support. In: SIGMOD ’97: Proceedings of the 1997 ACM SIGMOD international conference on Management of data, pp. 507–508. ACM, New York (1997). doi:10.1145/253260.253373
Venturi, V., Riedel, M., Memon, A.S., Memon, M.S., Stagni, F., Schuller, B., Mallmann, D., Tweddell, B., Gianoli, A., Ciaschini, V., van de Berghe, S., Snelling, D., Streit, A.: Using SAML-based VOMS for Authorization within Web Services-based UNICORE Grids. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par 2007 Workshops: Parallel Processing. LNCS, no. 4854, pp. 112–120. Springer, New York (2008)
Adreozzi, S., Burke, S., Ehm, F., Field, L., Galang, G., Konya, B., Litmaath, M., Millar, P., Navarro, J. (ed.): GLUE v. 2.0—Reference to Concrete Data Models. Tech. Rep., Global Grid Forum (2008)
GeoMaint Project: Informationprovider (Sensor) for Geolocation and Maintenance Data. http://geomaint.sourceforge.net/. Accessed September 2008
The Vine Toolkit: http://www.gridsphere.org/gridsphere/gridsphere/guest/vine/r/. Accessed September 2008
Author information
Authors and Affiliations
Corresponding author
Additional information
This work has been partly funded by the D-Grid Initiative of the German Federal Ministry of Education and Research (FKZ01IG07010A).
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Baur, T., Breu, R., Kálmán, T. et al. An Interoperable Grid Information System for Integrated Resource Monitoring Based on Virtual Organizations. J Grid Computing 7, 319–333 (2009). https://doi.org/10.1007/s10723-009-9134-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10723-009-9134-3