WSRF-Based Computing Framework of Distributed Data Stream Queries

Abstract

Many current and emerging applications require support for on-line analysis of rapidly changing data streams. Limitations of traditional DBMSs in supporting streaming applications have been recognized, prompting research to augment existing technologies and build new systems to manage streaming data. Stream-oriented systems are inherently geographically distributed and because distribution offers scalable load management and higher availability, future stream processing systems will operate in a distributed fashion. Meanwhile, service-based approaches have gained considerable attention recently for supporting distributed application development in e-business and e-science. In this paper, we present our innovative work to build a large scale distributed query processing over streaming data, this system has been designed as a WSRF-compliant Grid application built on top of standard Web and Grid services technologies. In this paper we first comparatively present various issues from our construction a WSRF-compliant prototype. Then we introduce a generic framework for solving distributed data stream query applications.

This work was sponsored by the National Science Foundation of China (NSFC) under the grant No.60273085 and the state High-tech Research and Development project (863) under the grant No.2002AA4Z3430.