Yuhui Jin
ABSTRACT
We present a design of a distributed publish-subscribe system that extends the functionality of messaging middleware with "relational subscriptions", to support timely updates to state derived from published messages while preserving high throughput, scalability, and reliability.Critical to our design is our service guarantee of "eventual correctness". Eventual correctness is a weaker guarantee than the ACID properties of conventional databases, yet is useful enough to deliver state that is "just consistent enough".A key component of our design is a monotonic type system. All states delivered to clients represent facts that are permanently true, that may be refined by future updates, but will never become false. The monotonic type system is used both to formalize eventual correctness, and as a basis for our implementation, which generalizes the "Guaranteed Delivery" protocol previously implemented in the Gryphon system.We discuss: (1) our monotonic type system and relational subscription language; (2) eventual correctness; (3) the architecture of our implementation; (4) potential optimizations that form a basis for future studies.
- Aguilera, M., Strom, R., Sturman, D., Astley, M., and Chandra, T., "Matching Events in a Content-Based Publish-Subscribe System", Proc., Principles of Distributed Computing, pp. 53--61, May, 1999.]] Google Scholar
Digital Library
- Altinel, M., and Franklin, M. J.: Efficient Filtering of XML Documents for Selective Dissemination of Information. In VLDB 2000.]] Google ScholarDigital Library
- Banavar, G., Chandra, T., Mukherjee, B., Nagarajarao, J., Strom, R., and Sturman, D. An Efficient Multicast Protocol for Content-Based Publish-Subscribe Systems. In Proceedings of the 19th IEEE International Conference on Distributed Computing Systems (ICDCS), 1998.]] Google ScholarDigital Library
- Bhola, S., Strom, R., Bagchi, S., Zhao, Y., and Auerbach, J., "Exactly Once Delivery in a Content-Based Publish-Subscribe System", Proc. International Conference on Dependable Systems and Networks, June 2002, Washington D. C.]] Google ScholarDigital Library
- Bonnet, P., Gehrke, J., and Seshadri, P. Towards sensor database systems. In 2nd International Conference on Mobile Data Management, Hong Kong, January 2001.]] Google ScholarDigital Library
- Avnur, R., and Hellerstein, J. M. Eddies: Continuously adaptive query processing. In ACM SIGMOD, Dallas, TX, May 2000.]] Google ScholarDigital Library
- Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., Zdonik, S. B.: Monitoring Streams - A New Class of Data Management Applications. VLDB 2002.]]Google Scholar
- Chandrasekaran, S., and Franklin, M., Streaming Queries over Streaming Data, In Proc. of the 28th VLDB Conference, Hong Kong, China, 2002.]]Google ScholarCross Ref
- Chen, J., DeWitt, D., Tian F., and Wang, Y. NiagaraCQ: A scalable continuous query system for internet databases. In ACM SIGMOD, 2000.]] Google ScholarDigital Library
- Cherniack, M., Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Xing, Y., and Zdonik, S. Scalable Distributed Stream Processing. In Proc. of the 1st Biennial Conference on Inovative Data Systems Research (CIDR 2003), Jan 2003, Asilomar, CA.]]Google Scholar
- Darwen, H., and Date, C. J. Foundation for Object/Relational Databases: The Third Manifesto. Addison-Wesley. June, 1998.]] Google ScholarDigital Library
- Fabret, F., Jacobsen H-A., Llirbat, F., Pereira, J., Ross, K. A., Shasha, D.: Filtering Algorithms and Implementation for Very Fast Publish/Subscribe. In Proc. of SIGMOD 2001.]] Google ScholarDigital Library
- Jagadish, H., Mumick, I., and Silberschatz, A. View Maintenance Issues for the Chronicle Data Model, ACM PODS, pp. 113--124, 1995.]] Google ScholarDigital Library
- Liu, L., Pu, C., and Tang, W. Continual queries for internet-scale event-driven information delivery. IEEE Knowledge and Data Engineering, Special Issue on Web Technology, 1999.]] Google ScholarDigital Library
- Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Datar, M., Manku, G., Olston, C., Rosenstein, J., and Varma, R.: Query Processing, Approximation, and Resource Management in a Data Stream Management System. In Proc. of the 1st Biennial Conference on Innovative Data Systems Research (CIDR 2003), Jan 2003, Asilomar, CA.]]Google Scholar
- Madden, S., and Franklin, M. Fjording the stream: An architecture for queries over streaming sensor data. ICDE. San Jose, CA, February 2002.]]Google ScholarCross Ref
- Madden, S., Szewczyk, R., Franklin, M., and Culler, D. Supporting Aggregate Queries Over Ad-Hoc Wireless Sensor Networks. Workshop on Mobile Computing and Systems Applications, 2002.]] Google ScholarDigital Library
- Madden, S., Shah, M., Hellerstein, J., and Raman, V. Continuously Adaptive Continuous Queries over Streams. In Proc. of SIGMOD, 2002.]] Google ScholarDigital Library
- Strom R., Extending a Content-Based Publish-Subscribe System with Relational Subscriptions, IBM Technical Report. At http://www.research.ibm.com/gryphon]]Google Scholar
- Terry, D., Goldberg, D., Nichols, D., and Oki, B., Continuous Queries over Append-Only Databases. In ACM SIGMOD, pp. 321--330, June, 1992.]] Google ScholarDigital Library
- Yao, Y., and Gehrke, J. Query Processing in Sensor Networks. In Proc. of the 1st Biennial Conference on Innovative Data Systems Research (CIDR 2003), Jan 2003, Asilomar, CA.]]Google Scholar
Index Terms
- Relational subscription middleware for Internet-scale publish-subscribe
Comments