Ahmed Alqaoud
ABSTRACT
Workflow interoperability is receiving increasing attention from the distributed computing community. Different standards and levels have been set to achieve interoperability among workflow system, for example, by the Workflow Management Coalition (WfMC). WS-based notification messaging systems provide a mechanism for decoupling and enabling asynchronous messaging among different applications in the distributed computing environment. In this paper a generic approach to achieving interoperability among workflow systems, based on a WS-based notification messaging system, is proposed. This approach exposes an API called Publish/Subscribe Scientific Workflow Interoperability Framework (PS-SWIF) that can be implemented in multiple workflow systems to provide run time interoperability. The PS-SWIF application is based on Web Services that enable scientists to apply a Publish/Subscribe mechanism to publish a topic using a workflow system, and enables different workflow systems to subscribe to this topic and receive notification messages when an event is executed.
- Globus Alliance and IBM. The WS-Resource Framework, 2004. Available at: URL http://www.globus.org/wsrf/.Google Scholar
- F. Curbera D. Box, E. Christensen et al. Web Services Addressing (WS-Addressing), 2004. Available at: URL http://www.w3.org/Submission/ws-addressing/.Google Scholar
- Susan B. Davidson, Sarah Cohen Boulakia, and Anat Eyal et al. Provenance in scientific workflow systems. IEEE Data Eng. Bull., 30(4):44--50, 2007.Google Scholar
- Ewa Deelman and Miron Livny. The pegasus approach to building a workflow management system.Google Scholar
- T. Delaitre, T. Kiss, A. Goyeneche, G. Terstyanszky, S. Winter, and P. Kacsuk. GEMLCA: Running legacy code applications as grid services. Journal of Grid Computing, 3(1):75--90, 2005.Google ScholarCross Ref
- UK e Science Programme. The OGSA-DAI Project. 2002. Available at: URL http://www.ogsadai.org.uk/.Google Scholar
- D. Box et al. Web services eventing (ws-eventing), 2004. Available at: URL http://www.w3.org/Submission/WS-Eventing/.Google Scholar
- IBM et al. Web services notification (ws-notification), 2004. Available at: URL http://www.ibm.com/developerworks/library/specification-/ws-notification/.Google Scholar
- National Science Foundation. The Kepler Project. 2002. Available at: URL https://kepler-project.org/.Google Scholar
- The National Science Foundation. Linked environments for atmospheric discovery (lead), 2003. Available at: URL http://www.renci.org/focus-areas/project-archive/lead.Google Scholar
- GGF. Global Grid Forum (GGF), 2001. Available at: URL http://www.ggf.org/.Google Scholar
- A. Harrison. The WSPeer Project. 2006. Available at: URL http://www.wspeer.org/.Google Scholar
- Andrew Harrison. Workflow sharing and interoperability. GridNet2 Report - Open Grid Forum OGF21, October 2007.Google Scholar
- D. Hollingsworth. Workflow management coalition: The workflow reference model. Document TC00--1003, Workflow Management Coalition, Jan, 1995.Google Scholar
- The European Bioinformatics Institute. Ebi soaplab web services. Available at: URL http://www.ebi.ac.uk/Tools/webservices/soaplab/overview.Google Scholar
- P. Kacsuk and G. Sipos. Multi-grid, multi-user workflows in the P-GRADE grid portal. Journal of Grid Computing, 3(3):221--238, 2005.Google ScholarCross Ref
- A. Kertesz, G. Sipos, and P. Kacsuk. Brokering multi-grid workflows in the P-GRADE portal. Lecture Notes in Computer Science, 4375:138, 2007. Google ScholarDigital Library
- K Klingenstein and D Gannon. Improving interoperability, sustainability and platform convergence in scientific and scholarly workflow. Technical report, University of Colorado and Indiana University, 2007.Google Scholar
- Scott Koranda. Ligo inspiral analysis workflow, 2007. Available at: URL https://spaces.internet2.edu/display/scischworkflow/Home.Google Scholar
- T. Kukla, T. Kiss, G. Terstyanszky, and P. Kacsuk. A general and scalable solution for heterogeneous workflow invocation and nesting. In Workflows in Support of Large-Scale Science, 2008. WORKS 2008. Third Workshop on, pages 1--8, Nov. 2008.Google ScholarCross Ref
- Virtual Laboratory. The Virtual laboratory for e-science. 2004.Google Scholar
- Philip Maechling. Scec earthquake wave propagation and source validation workflow, 2007. Available at: URL https://spaces.internet2.edu/display/scischworkflow/Home.Google Scholar
- Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Abstract Specification. The Workflow Management Coalition, 1996.Google Scholar
- Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Internet e-m MIME Binding. The Workflow Management Coalition, 2000.Google Scholar
- Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Wf-XML Binding. The Workflow Management Coalition, 2001.Google Scholar
- C. Nemeth, G. Dozsa, R. Lovas, and P. Kacsuk. The p-grade grid portal. Lecture Notes in Computer Science, pages 10--19, 2004.Google Scholar
- The University of Manchester and University of Southampton. myExpriment Project, 2007. Available at: URL http://www.myexperiment.org/workflows/159.Google Scholar
- T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M. R. Pocock, A. Wipat, et al. Taverna: a tool for the composition and enactment of bioinformatics workflows, 2004.Google Scholar
- I. Rice, P. Longden and A. Bleasby. The european molecular biology open software suite (emboss), 2003. Available at: URL http://emboss.sourceforge.net/what/.Google Scholar
- and D Chappell S Graham, P Niblett. Web Services Base Notification (WS-Base Notification), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.Google Scholar
- and D Chappell S Graham, P Niblett. Web Services Brokered Notification (WS-BrokeredNotification), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.Google Scholar
- and D Chappell S Graham, P Niblett. Web Services Topics (WS-Topics), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.Google Scholar
- H Son and X Li. High Performance Computing and Communications, chapter PARMI: A Publish/Subscribe Based Asynchronous RMI Framework for Cluster Computing. Springer Berlin/Heidelberg, 2007. Google ScholarDigital Library
- swif. The Publish/Subscribe Model for Scientific Workflow System. 2009. Available at: URL http://swif.cs.cf.ac.uk/.Google Scholar
- Ian Taylor. Workflow management research group - wfm-rg. GridNet2 Report - Open Grid Forum OGF22, February 2008.Google Scholar
- Adrian Toth. Levels of the grid workflow interoperability. Open Grid Forum OGF20, May 2007.Google Scholar
- S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, C. Kesselman, T. Maquire, T. Sandholm, D. Snelling, and P. Vanderbilt. Open grid services infrastructure (OGSI). In Global Grid Forum, 2003.Google Scholar
- Cardiff University. The Triana Project. Available at: URL http://www.trianacode.org.Google Scholar
- Cardiff University. School of Computer Science. 1883. Available at: URL http://www.cs.cf.ac.uk/.Google Scholar
- Z. Zhao and Booms. Vle-wfbus: a scientific workflow bus for multi e-science domains. In Second IEEE International Conference on e-Science and Grid Computing, 2006., pages 11--11, 2006. Google ScholarDigital Library
Index Terms
- Publish/subscribe as a model for scientific workflow interoperability
Recommendations
A Survey of Data-Intensive Scientific Workflow Management
Nowadays, more and more computer-based scientific experiments need to handle massive amounts of data. Their data processing consists of multiple computational steps and dependencies within them. A data-intensive scientific workflow is useful for ...
A Formal Approach to Support Interoperability in Scientific Meta-workflows
Scientific workflows orchestrate the execution of complex experiments frequently using distributed computing platforms. Meta-workflows represent an emerging type of such workflows which aim to reuse existing workflows from potentially different workflow ...
Scientific Workflow Partitioning in Multisite Cloud
Revised Selected Papers, Part I, of the Euro-Par 2014 International Workshops on Parallel Processing - Volume 8805Scientific workflows allow scientists to conduct experiments that manipulate data with multiple computational activities using Scientific Workflow Management Systems SWfMSs. As the scale of the data increases, SWfMSs need to support workflow execution ...
Comments