Alex C. Snoeren
Skip Abstract Section
Abstract
We have developed a new approach for reliably multicasting time-critical data to heterogeneous clients over mesh-based overlay networks. To facilitate intelligent content pruning, data streams are comprised of a sequence of XML packets and forwarded by application-level XML routers. XML routers perform content-based routing of individual XML packets to other routers or clients based upon queries that describe the information needs of downstream nodes. Our PC-based XML router prototype can route an 18 Mbit per second XML stream.Our routers use a novel Diversity Control Protocol (DCP) for router-to-router and router-to-client communication. DCP reassembles a received stream of packets from one or more senders using the first copy of a packet to arrive from any sender. When each node is connected to n parents, the resulting network is resilient to (n − 1) router or independent link failures without repair. Associated mesh algorithms permit the system to recover to (n − 1) resilience after node and/or link failure. We have deployed a distributed network of XML routers that streams real-time air traffic control data. Experimental results show multiple senders improve reliability and latency when compared to tree-based networks.
- 1 XMLBiaster. http://www.xralblaster, org/.]]Google Scholar
- 2 ANDERSEN, D. G., BALAKRISHNAN, H., KAASHOEK, M. F., AND MORRIS, R. T. Resilient overlay networks. In Proc. ACM SOSP (Oct. 2001).]] Google ScholarDigital Library
- 3 ARMSTRONG, S., ET AL. Multicast transport protocol. RFC 1301, Internet Engineering Task Force, 1992.]]Google Scholar
- 4 BANAVAR, G., CHANDRA, T., MUKHERJEE, B., NAGARA- JARAO, J., STROM, R., AND STURMAN, D. An efficient multicast protocol for content-based publish-subscribe systems. In Proc. lnt'l Conf. on Dist. Comp. Systems (ICDCS) (May 1999).]] Google ScholarDigital Library
- 5 BANERJEA, A. Simulation study of the capacity effects of dispersity routing for fault tolerant realtime channels. In Proc. ACM SIGCOMM (Aug. 1996), pp. 194-205.]] Google ScholarDigital Library
- 6 BESTAVROS, A. An adaptive information dispersal algorithm for time-critical reliable communication. In Network Management and Control, Volume II, I. Frish, M. Malek, and S. Panwar, Eds. Plenum Publishing Co., New York, New York, 1994, pp. 423--438.]]Google ScholarCross Ref
- 7 BRAY, T., ET AL. Extensible markup language 1.0 (second edition), http : //www.w3. org/TR/REC-xml/, W3C Recommendation, 2000.]]Google Scholar
- 8 BYERS, J. W., LUBY, M., AND MITZENMACHER, M. Accessing multiple mirror sites in parallel: Using tornado codes to speed up downloads. In Proc. IEEE Infocom (Mar. 1999), pp. 275-283.]]Google ScholarCross Ref
- 9 BYERS, J. W., LUBY, M., MITZENMACHER, M., AND REGE, A. A digital fountain approach to reliable distribution of bulk data. In Proc. ACM SIGCOMM (Sept. 1998), pp. 56--67.]] Google ScholarDigital Library
- 10 CARZANIGA, A., ROSENBLUM, D. S., AND WOLF, A. L. Achieving scalability and expressiveness in an Internet-scale event notification service. In Proc. ACM PODC (July 2000), pp. 219-227.]] Google ScholarDigital Library
- 11 CHAMBERL1N, D., ET AL. XQuery 1.0; A XML query language, http: //www.w3.org/TR/xquery/W3C Working Draft, 2001.]]Google Scholar
- 12 CHAWATHE, Y., MCCANNE, S., AND BREWER, E. RMX: Reliable multicast for heterogeneous networks. In Proc. IEEE lnfocom (Mar. 2000), pp. 795-804.]]Google ScholarCross Ref
- 13 CHU, Y., RAt, S. G., AND ZHANG, H. The case for end system multicast. In Proc. ACM SIGMETRICS (June 2000), pp. 1-12.]] Google ScholarDigital Library
- 14 FLOYD, S., JACOBSON, V., MCCANNE, S., LIU, C.-G., AND ZHANG, L. A reliable multicast framework for lightweight sessions and application level framing. IEEE/ACM Trans. on Networking 5, 6 (Dec. 1997), 784-803.]] Google ScholarDigital Library
- 15 HOLBROOK, H. W., AND CHERITON, D. R. IP multicast channels: EXPRESS support for large-scale single-source applications. In Proc. ACMSIGCOMM (Aug. 1999), pp. 65-78.]] Google ScholarDigital Library
- 16 JANNOTTI, J., GIFFORD, D. K., JOHNSON, K., KAASHOEK, M. F., AND O'TOOLE, J. Overcast: Reliable multicasting with an overlay network. In Proc. USENIX OSDI (Oct. 2000), pp. 197-212.]] Google ScholarDigital Library
- 17 KADANSKY, M., CHIU, D., AND WESLEY, J. Tree-based reliable multicast {TRAM}. Technical report TR-98-66, Sun Microsystems Lab, 1998.]] Google ScholarDigital Library
- 18 KARN, P., AND PARTRIDGE, C. Improving round-trip time estimates in reliable transport protocols. ACM CCR 17, 5 (Aug. 1987), 2-7.]] Google ScholarDigital Library
- 19 KOHLER, E., MORRIS, R., CHEN, B., JANNOTTI, J., AND KAASHOEK, M. F. The click modular router. ACM Trans. on Computer Systems 18, 3 (Aug. 2000), 263-297.]] Google ScholarDigital Library
- 20 LABOVITZ, C., AHUJA, A., ABOSE, A., AND JAHANIAN, F. Routing stability and convergence. In Proc. ACM SIGCOMM (Aug. 2000), pp. 115-126.]]Google Scholar
- 21 LEMPEL, A., AND ZIV, J. A universal algorithm for sequential data compression. IEEE Trans. on Information Theory 23, 3 (May 1977), 337-343.]]Google Scholar
- 22 L1N, J.-C., AND PAUL, S. RMTP: A reliable multicast transport protocol. In Proc. IEEE lnfocom (Mar. 1996), pp. 1414- 1424.]]Google Scholar
- 23 MANBER, U. Finding similar files in a large file system. In Proc. Winter USENIX (Jan. 1994), pp. 1-10.]] Google ScholarDigital Library
- 24 MAXEMCHUK, N. F. Dispersity Routing in Store and Forward Networks. PhD thesis, University of Pennsylvania, May 1975.]]Google Scholar
- 25 MCAULEY, A. J. Reliable broadband communication using a burst erasure correcting code. In Proc. ACM SIGCOMM (Sept. 1990), pp. 297-306.]] Google ScholarDigital Library
- 26 MCCANNE, S., AND JACOBSON, V. Receiver-driven layered multicast. In Proc. ACM SIGCOMM (Aug. 1996), pp. 117- 130.]] Google ScholarDigital Library
- 27 MOSER, L., MELLIAR-SMITH, P., AGARWAL, D., BUD- HIA, R., AND LINOLEY-PAPADOPOULOS, C. Totem: A fault-tolerant multicast group communication system. C. ACM 39, 4 (Apr. 1996), 54--63.]] Google ScholarDigital Library
- 28 OKI, B., PFLUEGL, M., SIEGEL, A., AND SKEEN, D. The information bus -- an architecture for extensible distributed systems. In Proc. ACM SIGOPS (Dec. 1993), pp. 58-68.]] Google ScholarDigital Library
- 29 PAXSON, V. End-to-end intemet packet dynamics. IEEE/ACM Trans. on Networking 7, 3 (June 1999), 277-292.]] Google ScholarDigital Library
- 30 PENDARAKIS, D., SHI, S., VERMA, D., AND WALDVOGEL, M. ALMI: An application level multicast infrastructure. In Proc. USENIX Syrup. on lnternet Technologies and Systems (USITS) (Mar. 2001), pp. 49-60.]] Google ScholarDigital Library
- 31 RABIN, i . O. Efficient dispersal of information for security, load balancing and fault tolerance. J. ACM 36, 2 (Apr. 1989), 335-348.]] Google ScholarDigital Library
- 32 RlZZO, L. Dummynet: a simple approach to the evaluation of network protocols. ACM CCR 27, 1 (Jan. 1997).]] Google ScholarDigital Library
- 33 RlZZO, L., AND VICISANO, L. A reliable multicast data distribution protocol based on software DEC techniques. In Proc. IEEE HPCS (June 1997).]]Google Scholar
- 34 SANTRY, D. J., FEELEY, i . J., HUTCHINSON, N. C., AND VEITCH, A. C. Elephant: The file system that never forgets. In Proc. Workshop on Hot Topics in Operating Systems (HotOS-Vll) (Mar. 1999).]] Google ScholarDigital Library
- 35 SAVAGE, S., ANDERSON, T., AGGARWAL, A., BECKER, D., CARDWELL, N., COLLINS, A., HOFFMAN, E., SNELL, J., VAHDAT, A., VOELKER, J., AND ZAHORJAN, J. Detour: a case for informed internet routing and transport. IEEE Micro 19, 1 (Jan. 1999), 50-59.]] Google ScholarDigital Library
- 36 SEGALL, B., ARNOLD, D., BOOT, J., HENDERSON, M., AND PHELPS, T. Content based routing with Elvin4. In Proc. AUUG2K (June 2000).]]Google Scholar
- 37 STOICA, I., NG, T. S. E., AND ZHANG, H. Reunite: A recursive unicast approach to multicast. In Proc. IEEE Infocom (Mar. 2000), pp. 1644-1653.]]Google Scholar
- 38 TRIDGELL, A. Efficient Algorithms for Sorting and Synchronization. PhD thesis, Australian National University, Apr. 2000.]]Google Scholar
- 39 TRIDGELL, A., AND MACKERRAS, P. The rsync algorithm. Tech. Rep. TR-CS-96-05, Australian National University, 1997.]]Google Scholar
- 40 VOLPE NATIONAL TRANSPORTATION CENTER, AUTOMA- TION APPLICATIONS DIVISION. Aircraft situation display to industry functional description and interfaces. DTS-56 report, Aug. 2000.]]Google Scholar
- 41 WHETTEN, B., AND TASKALE, G. An overview of reliable multicast transport protocol II. 1EEE Network 14, 1 (Jan. 2000), 37-47.]]Google Scholar
- 42 Wo, L., SHARMA, R., AND SMITH, B. Thin streams: An architecture for multicasting layered video. In ProctEEElnt'l Workshop on Network and Operating System Support for Digital Audio and Video (May 1997).]]Google Scholar
- 43 YAVATKAR, R., GRIFFIOEN, J., AND SUDAN, M. A reliable dissemination protocol for interactive collaborative applications. In Proc. ACM Conf. on Multimedia (Nov. 1995), pp. 371-372.]] Google ScholarDigital Library
Index Terms
- Mesh-based content routing using XML
Recommendations
Mesh-based content routing using XML
SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principlesWe have developed a new approach for reliably multicasting time-critical data to heterogeneous clients over mesh-based overlay networks. To facilitate intelligent content pruning, data streams are comprised of a sequence of XML packets and forwarded by ...
Multicast cloud with integrated multicast and unicast content distribution routing
Web content caching and distributionIn this paper, we describe the concept and design of "application-layer multicast cloud," the first overlay network design that provides integrated content distribution routing between IP multicast and unicast via a user-configured group of multicast ...
TCP performance evaluation over backpressure-based routing strategies for wireless mesh backhaul in LTE networks
Wireless redundant networks are expected to play a fundamental role to backhaul dense LTE networks. In these scenarios, backpressure-based routing strategies such as BP-MR can exploit the network redundancy. In this paper, we perform an exhaustive ...
Comments