Skip to main content
SpringerLink
Log in

DotSlash: A Self-Configuring and Scalable Rescue System for Handling Web Hotspots Effectively

  • Conference paper
Web Content Caching and Distribution (WCW 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3293))

Included in the following conference series:

Abstract

DotSlash allows different web sites to form a mutual-aid community, and use spare capacity in the community to relieve web hotspots experienced by any individual site. As a rescue system, DotSlash intervenes when a web site becomes heavily loaded, and is phased out once the workload returns to normal. It aims to complement the existing web server infrastructure to handle short-term load spikes effectively. DotSlash is self-configuring, scalable, cost-effective, easy to use, and transparent to clients. It targets small web sites, although large web sites can also benefit from it. We have implemented a prototype of DotSlash on top of Apache. Experiments show that using DotSlash a web server can increase the request rate it supported and the data rate it delivered to clients by an order of magnitude, even if only HTTP redirect is used. Parts of this work may be applicable to other services such as Grid computational services.

This work was supported in part by the National Science Foundation (ANI-0117738).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abdelzaher, T., Bhatti, N.: Web server QoS management by adaptive content delivery. In: International Workshop on Quality of Service (IWQoS), London, England (June 1999)

    Google Scholar 

  2. Adler, S.: The slashdot effect: An analysis of three Internet publications, http://ssadler.phy.bnl.gov/adler/SDE/SlashDotEffect.html

  3. Akamai homepage, http://www.akamai.com/

  4. Apache. HTTP server project, http://httpd.apache.org/

  5. Aron, M., Sanders, D., Druschel, P., Zwaenepoel, W.: Scalable context-aware request distribution in cluster-based network servers. In: Annual Usenix Technical Conference, San Diego, California (June 2000)

    Google Scholar 

  6. Barbir, A., Cain, B., Nair, R., Spatscheck, O.: Known content network (CN) requestrouting mechanisms. RFC 3568, Internet Engineering Task Force (July 2003)

    Google Scholar 

  7. BitTorrent homepage, http://bitconjurer.org/BitTorrent/

  8. Cardellini, V., Casalicchio, E., Colajanni, M., Yu, P.: The state of the art in locally distributed web-server systems. ACM Computing Surveys 34(2), 263–311 (2002)

    Article  Google Scholar 

  9. Cardellini, V., Colajanni, M., Yu, P.S.: Geographic load balancing for scalable distributed web systems. In: International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), San Francisco, California (August 2000)

    Google Scholar 

  10. Coffman, E., Jelenkovic, P., Nieh, J., Rubenstein, D.: The Columbia hotspot rescue service: A research plan. Technical Report EE2002-05-131, Department of Electrical Engineering, Columbia University (May 2002)

    Google Scholar 

  11. Day, M., Cain, B., Tomlinson, G., Rzewski, P.: A model for content internetworking (CDI). RFC 3466, Internet Engineering Task Force (February 2003)

    Google Scholar 

  12. Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid: Enabling scalable virtual organizations. International J. Supercomputer Applications 15(3) (2001)

    Google Scholar 

  13. Guttman, E., Perkins, C.E., Veizades, J., Day, M.: Service location protocol, version 2. RFC 2608, Internet Engineering Task Force (June 1999)

    Google Scholar 

  14. Jung, J., Krishnamurthy, B., Rabinovich, M.: Flash crowds and denial of service attacks: Characterization and implications for CDNs and web sites. In: International World Wide Web Conference (WWW), Honolulu, Hawaii (May 2002)

    Google Scholar 

  15. Kong, K., Ghosal, D.: Mitigating server-side congestion in the Internet through pseudoserving. IEEE/ACM Transactions on Networking 7(4), 530–544 (1999)

    Article  Google Scholar 

  16. LeFebvre, W.: CNN.com: Facing a world crisis. Invited talk at USENIX LISA (December 2001)

    Google Scholar 

  17. Li, Q., Moon, B.: Distributed cooperative Apache web server. In: International World Wide Web Conference, Hong Kong (May 2001)

    Google Scholar 

  18. Mosberger, D., Jin, T.: httperf—a tool for measuring web server performance. In: Workshop on Internet Server Performance (WISP), Madison, Wisconsin (June 1998)

    Google Scholar 

  19. Netcraft. Web server survey, http://news.netcraft.com/archives/web_server_survey.html

  20. Padmanabhan, V., Sripanidkulchai, K.: The case for cooperative networking. In: Druschel, P., Kaashoek, M.F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, p. 178. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  21. PlanetLab, http://www.planet-lab.org/

  22. RRDtool homepage, http://people.ee.ethz.ch/~oetiker/webtools/rrdtool/

  23. Rzewski, P., Day, M., Gilletti, D.: Content internetworking (CDI) scenarios. RFC 3570, Internet Engineering Task Force (July 2003)

    Google Scholar 

  24. Schwarz, S.: Web servers, earthquakes, and the slashdot effect, http://pasadena.wr.usgs.gov/office/stans/slashdot.html

  25. Stading, T., Maniatis, P., Baker, M.: Peer-to-peer caching schemes to address flash crowds. In: Druschel, P., Kaashoek, M.F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, p. 203. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  26. Stavrou, A., Rubenstein, D., Sahu, S.: A lightweight, robust P2P system to handle flash crowds. In: IEEE International Conference on Network Protocols (ICNP), Paris, France (November 2002)

    Google Scholar 

  27. Vakali, A., Pallis, G.: Content delivery networks: Status and trends. IEEE Internet Computing 7(6), 68–74 (2003)

    Article  Google Scholar 

  28. Vixie, P., Thomson, S., Rekhter, Y., Bound, J.: Dynamic updates in the domain name system (DNS UPDATE). RFC 2136, Internet Engineering Task Force (April 1997)

    Google Scholar 

  29. Wang, J.: A survey of web caching schemes for the Internet. ACM Computer Communication Review (CCR) 29(5) (October 1999)

    Google Scholar 

  30. Wang, L., Pai, V., Peterson, L.: The effectiveness of request redirection on CDN robustness. In: Symposium on Operating Systems Design and Implementation (OSDI), Boston, Massachusetts (December 2002)

    Google Scholar 

  31. Welsh, M., Culler, D.: Adaptive overload control for busy Internet servers. In: USENIX Conference on Internet Technologies and Systems (USITS), Seattle,Washington (March 2003)

    Google Scholar 

  32. Zhao, W., Schulzrinne, H.: Selective anti-entropy. In: ACM Symposium on Principles of Distributed Computing, Monterey, California (July 2002)

    Google Scholar 

  33. Zhao, W., Schulzrinne, H., Guttman, E.: Mesh-enhanced service location protocol (mSLP). RFC 3528, Internet Engineering Task Force (April 2003)

    Google Scholar 

  34. Zhao, W., Schulzrinne, H., Guttman, E., Bisdikian, C., Jerome, W.: Select and sort extensions for the service location protocol (SLP). RFC 3421, Internet Engineering Task Force (November 2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Columbia University, New York, NY, 10027, USA

    Weibin Zhao & Henning Schulzrinne

Authors
  1. Weibin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Henning Schulzrinne
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Software, Tsinghua University,  

    Chi-Hung Chi

  2. Department of Computer Science, Vrije Universiteit Amsterdam, The Netherlands

    Maarten van Steen

  3. Computer Science Department, Worcester Polytechnic Institute, 100 Institute Road, 01609, Worcester, MA, USA

    Craig Wills

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhao, W., Schulzrinne, H. (2004). DotSlash: A Self-Configuring and Scalable Rescue System for Handling Web Hotspots Effectively. In: Chi, CH., van Steen, M., Wills, C. (eds) Web Content Caching and Distribution. WCW 2004. Lecture Notes in Computer Science, vol 3293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30471-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30471-5_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23516-3

  • Online ISBN: 978-3-540-30471-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation