Skip to main content
SpringerLink
Log in

Workflow Concepts of the Java CoG Kit

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Many scientific simulations and experiments require the coordination of numerous tasks posed by interdisciplinary research teams. Grids can provide access to the necessary high-end resources to conduct such tasks. The complex tasks and their interactions must be supported through convenient tools. To address this issue, we introduce a number of Grid abstractions that make the development of Grid middleware-independent tools possible and allow for the integration of a number of commodity tools. Our vision is implemented through an integrated approach based on a layered architecture that bridges the gap between Grid middleware and scientific applications. Our abstractions include specialized services, a Grid workflow engine and language, and Gridfaces – graphical abstractions that can be employed in science portals and standalone applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. D. Abramson, “Nimrod Home Page, March 2002”. Available from: http://www.csse.monash.edu.au/~davida/nimrod.html/.

  2. “The Access Grid”. Web Page. Available from: http://www-fp.mcs.anl.gov/fl/accessGrid/.

  3. K. Amin, M. Hategan, G. von Laszewski, N.J. Zaluzec, S. Hampton and A. Rossi, “GridAnt: A client-controllable Grid workflow system”, in 37th Hawai’i International Conference on System Science, Island of Hawaii, Big Island, 5–8 January 2004. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski--Gridant-hics.pdf.

  4. T. Andrews, F. Curbera, Y. Gol, H. Dholakia, J. Klein, F. Leymann, K. Liu, D. Roller, D. Smith, S. Thatte, in Ivana Trickovic and Sanjiva Weerawarana (eds.), Business Process Execution Language for Web Services. [BPEL4WS.], May 2003. Available from: http://xml.coverpages.org/BPELv11-May052003Final.pdf.

  5. H.P. Bivens, “Grid WorkFlow: Grid Computing Environments Working Group Document.” http://www.Gridforum.org, 2001.

  6. “The Java CoG Kit Source Code”. CVS Repository. Available from: http://www.cvs.cogkit.org.

  7. “DAGMan (Directed Acyclic Graph Manager)”. Web Page. Available from: http://www.cs.wisc.edu/condor/dagman/.

  8. E. Deelman, J. Blythe, Y. Gil and C. Kesselman, “Pegasus: Planning for Execution in Grids”, 2002. Available from: http://www.isi.edu/~deelman/Pegasus/pegasus%20overview.pdf.

  9. E. Deelman, J. Blythe, Y. Gil and C. Kesselman, Grid Resource Management, Chapter “Workflow Management in GriPhyN”, Kluwer, 2003. Available from: http://www.isi.edu/~deelman/Pegasus/grm_chapter.pdf.

  10. J. Futrelle, “Tupelo: Semantic content repository”. Web Page, 2005. Available from: http://dlt.ncsa.uiuc.edu/wiki/index.php/Main_Page.

  11. “Grid application toolkit”. Web Page. Available from: http://www.Gridlab.org/WorkPackages/wp-1/.

  12. “The Globus Alliance”. Web Page. Available from: http://www.globus.org.

  13. A. Hoheisel and U. Der, “An XML-Based framework for loosely coupled applications on Grid environments”, in ICCS 2003, Vol. 2657 of LNCS, pp. 245–254. Springer, 2003. Available from: http://www.andreas-hoheisel.de/docs/Hoheisel_and_Der_2003_ICCS.pdf.

  14. “Java Commodity Grid (CoG) Kit”. Web Page. Available from: http://www.cogkit.org.

  15. K. Keahey, I. Foster, T. Freeman, X. Zhang and D. Galron, “Virtual workspaces in the Grid”, in Europar 2005, Lisbon, Portugal, September 2005. Available from: http://workspace.globus.org/papers/VWCluster_TR_ANL_MCS-P1246-0405.pdf.

  16. “Kepler”. Web Page. Available from: http://kepler.ecoinformatics.org/.

  17. B. Kiepuszewski1, A.H.M. ter Hofstede1 and W.M.P. van der Aalst, “Fundamentals of control flow in workflows. Technical report, Centre for Information Technology Innovation, Queensland University of Technology, November 2003.” Available from: http://tmitwww.tm.tue.nl/research/patterns/download/qut_expr_rep.pdf.

  18. B. Ludaescher, A. Gupta and M.E. Martone, Bioinformatics: Managing Scientific Data, Chapter “A Model-Based Mediator System for Scientific Data Management”, Morgan Kaufmann, 2003. Available from: http://citeseer.nj.nec.com/cache/papers/cs/27492/http:zSzzSzwww.sdsc.eduzSz~ guptazSzpublicationszSzmbm-chapter-rev.pdf/a-model-based-mediator.pdf.

  19. “Open Grid Computing Environments”, Web Page. Available from: http://www.ogce.org.

  20. “Pegasus”. Web Page. Available from: http://pegasus.isi.edu/.

  21. J.M. Schopf, M. D’Arcy, N. Miller, L. Pearlman, I. Foster and C. Kesselman, “Monitoring and discovery in a web services framework: Functionality and performance of the globus toolkit’s mds4.” Preprint ANL/MCS-P1248-0405, Argonne National Laboratory, Argonne, Illinois, 2005. Available from: http://www-unix.mcs.anl.gov/~schopf/Pubs/mds-sc05.pdf.

  22. E. Seidel, G. Allen, A. Merzky and J. Nabrzyski, “Gridlab: A Grid application toolkit and testbed”, Future Generation Computer Systems, Vol. 18, pp. 1143–1153, 2002.

    Article  MATH  Google Scholar 

  23. “The Taverna Project”. Web Page, December 2003. Available from: http://taverna.sourceforge.net.

  24. I. Taylor, S. Majithia, M. Shields and I. Wang, “Triana workflow specification”. Technical report, GridLab.

  25. “Teuta”. Web Page. Available from: http://dps.uibk.ac.at/projects/prophet/node4.html.

  26. D. Thain, T. Tannenbaum and M. Linvy, Grid Computing: Making the Global Infrastructure a Reality, Chapter “Condor and the Grid”, Wiley, pp. 299–336, 2003, Number ISBN:0-470-85319-0.

  27. “Triana Workflow”. Web Page. Available from: http://www.triana.co.uk.

  28. “Unicore”. Web Page. Available from: http://www. unicore.de/.

  29. W.M.P. van der Aalst, “The Application of Petri Nets to Workflow Management”, Paper, Department of Mathematics and Computing Science, Eindhoven University of Technology, NL-5600 MB, Eindhoven, The Netherlands, 1998. Available from: http://is.tm.tue.nl/staff/wvdaalst/publications/p53.pdf.

  30. G. von Laszewski, A Parallel Data Assimilation System and Its Implications on a Metacomputing Environment, PhD thesis, Syracuse University, December 1996.

  31. G. von Laszewski, “An interactive parallel programming environment applied in Atmospheric Science”, in G.-R. Hoffman and N. Kreitz (eds.), Making Its Mark, Proceedings of the 6th Workshop on the Use of Parallel Processors in Meteorology, pp. 311–325, Reading, UK, 2–6 December 1996. European Centre for Medium Weather Forecast, World Scientific. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski–ecwmf-interactive.pdf.

  32. G. von Laszewski, “A loosely coupled metacomputer: Cooperating job submissions across multiple supercomputing sites”, Concurrency, Experience, and Practice, Vol. 11, No. 5, pp. 933–948, December 1999. The initial version of this paper was available in 1996. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski– CooperatingJobs.pdf.

  33. G. von Laszewski, “The Grid-idea and its evolution”, Information Technology, accepted for publication. Argonne National Laboratory, Argonne, Illinois 60439, U.S.A. Available from: http://www.mcs.anl.gov/~gregor/papers/von Laszewski-Grid-idea.pdf.

  34. G. von Laszewski and K. Amin, Grid Middleware, Chapter “Middleware for Communications”, pp. 109–130. Wiley, 2004. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski–Grid-middleware.pdf.

  35. G. von Laszewski, K. Amin, S. Hampton and S. Nijsure, “GridAnt – White Paper”, Technical report, Argonne National Laboratory, 31 July 2002. Available from: http://www. mcs.anl.gov/~gregor/papers/vonLaszewski-Gridant.pdf.

  36. G. von Laszewski, S. Fitzgerald, I. Foster, C. Kesselman, W. Smith and S. Tuecke, “A directory service for configuring high-performance distributed computations”, in Proceedings of the 6th IEEE Symposium on High-Performance Distributed Computing, pp. 365–375, Portland, Oregon, 5–8 August 1997. Available from: http://www.mcs.anl.gov/~gregor/papers/fitzgerald--hpdc97-mds.pdf.

  37. G. von Laszewski, I. Foster, J. Gawor, W. Smith and S. Tuecke, “CoG Kits: A bridge between commodity distributed computing and high-performance Grids”, in ACM Java Grande 2000 Conference, pp. 97–106, San Francisco, California, 3–5 June 2000. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski–cog-final.pdf.

  38. G. von Laszewski, J. Gawor, S. Krishnan and K. Jackson, Grid Computing: Making the Global Infrastructure a Reality, Chapter “Commodity Grid Kits – Middleware for Building Grid Computing Environments”, pp. 639–656. Communications Networking and Distributed Systems. Wiley, 2003. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski–Grid2002book.pdf.

  39. G. von Laszewski and M. Hategan, “Grid workflow – An integrated approach”, in Technical Report, Argonne National Laboratory, Argonne National Laboratory, 9700 S. Cass Ave., Argonne, Illinois 60440, 2005. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski-workflow-draft.pdf.

  40. G. von Laszewski and D. Kodeboyina, “A repository service for Grid workflow components”, in International Conference on Autonomic and Autonomous Systems International Conference on Networking and Services. IEEE, 23–28 October 2005. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski-workflow-repository. pdf.

  41. G. von Laszewski, B. Ruscic, K. Amin, P. Wagstrom, S. Krishnan, and S. Nijsure, “A framework for building scientific knowledge Grids applied to thermochemical tables”, The International Journal of High Performance Computing Applications, Vol. 17, No. 4, pp. 431–447, Winter 2003. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski–knowledge-Grid.pdf.

    Article  Google Scholar 

  42. G. von Laszewski and M. Sosonkin, “A Grid certificate authority for community and ad-hoc Grids”, in 7th International Workshop on Java for Parallel and Distributed Computing, published in the Proceedings of the 19th International Parallel and Distributed Processing Symposium, Denver, Colorado, 4–8 April 2005. IEEE. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski-ca-workshop.pdf.

  43. G. von Laszewski, M.-H. Su, J.A. Insley, I. Foster, J. Bresnahan, C. Kesselman, M. Thiebaux, M.L. Rivers, S. Wang, B. Tieman and I. McNulty, “Real-time analysis, visualization, and steering of microtomography experiments at photon sources”, in Ninth SIAM Conference on Parallel Processing for Scientific Computing, San Antonio, Texas, 22–24 March 1999. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski--siamCmt99.pdf.

  44. G. von Laszewski and P. Wagstrom, Tools and Environments for Parallel and Distributed Computing, Chapter “Gestalt of the Grid”, pp. 149–187. Parallel and Distributed Computing. Wiley, 2004. Available from: http://www.mcs.anl.gov/~gregor/papers/vonLaszewski- -gestalt.pdf.

  45. P. Wagstrom, S. Krishnan and G. von Laszewski, “GSFL: A workflow framework for Grid services”, in SC’2002, Baltimore, Maryland, 11–16 November 2002. (Poster). Available from: http://www.mcs.anl.gov/~gregor/papers/gsfl-paper.pdf.

  46. “The Workflow Reference Model”, The Workflow Management Coalition, January 1995. Available from: http://www.wfmc.org/standards/docs/tc003v11.pdf.

  47. J. Yu and R. Buyya, “A taxonomy of scientific workflow systems for Grid computing, ACM Special Interest Group On Management of Data (SIGMOD), 2005. Available from: http://www.sigmod.org/sigmod/record/issues/0509/p44-special-sw-section-7.pdf.

Download references

Author information

Authors and Affiliations

  1. Mathematics and Computer Science Division, Argonne National Laboratory, Argonne National Laboratory, 9700 S. Cass Ave., Argonne, IL, 60440, USA

    Gregor von Laszewski

  2. Computation Institute, University of Chicago, Research Institutes Building #402, 5640 S. Ellis Ave., Chicago, IL, 60637-1433, USA

    Gregor von Laszewski & Mike Hategan

Authors
  1. Gregor von Laszewski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mike Hategan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gregor von Laszewski.

Rights and permissions

Reprints and permissions

About this article

Cite this article

von Laszewski, G., Hategan, M. Workflow Concepts of the Java CoG Kit. J Grid Computing 3, 239–258 (2005). https://doi.org/10.1007/s10723-005-9013-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-005-9013-5

Key words

Search

Navigation