skip to main content
article
Free Access

Summary cache: a scalable wide-area Web cache sharing protocol

Authors Info & Claims
Published:01 October 1998Publication History
Skip Abstract Section

Abstract

The sharing of caches among Web proxies is an important technique to reduce Web traffic and alleviate network bottlenecks. Nevertheless it is not widely deployed due to the overhead of existing protocols. In this paper we propose a new protocol called "Summary Cache"; each proxy keeps a summary of the URLs of cached documents of each participating proxy and checks these summaries for potential hits before sending any queries. Two factors contribute to the low overhead: the summaries are updated only periodically, and the summary representations are economical --- as low as 8 bits per entry. Using trace-driven simulations and a prototype implementation, we show that compared to the existing Internet Cache Protocol (ICP), Summary Cache reduces the number of inter-cache messages by a factor of 25 to 60, reduces the bandwidth consumption by over 50%, and eliminates between 30% to 95% of the CPU overhead, while at the same time maintaining almost the same hit ratio as ICP. Hence Summary Cache enables cache sharing among a large number of proxies.

References

  1. 1 B. M. Duska, D. Marwood, and M. J. Feeley, "The measured access characteristics of World-Wide-Web client proxy caches," in Proc. USENiX Syrup. on Internet Technologies and Systems, pp. 23-35, December 1997. http://www, cs. ubc. ca/spider/marwood/Proj ects/ SPA/wwwap.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. 2 "Squid intemet object cache." http://squid.nlanr .net/Squid.]]Google ScholarGoogle Scholar
  3. 3 R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich, "Web proxy caching: The devil is in the details," in Proc. Workshop on Internet Server Performance, June 1998. http: //www. cs. wisc. edu/-cao/WiSP98, html.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 4 A. Bestavros, R. L. Carter, and M. E. Crovella, "Application-level document caching in the Intemet," in Proc. Inter. Workshop on Services in Distributed and Networked Environments, June 1995. http://www, cs. bu. edu/f acuity/best/res/ paperm/Home.html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. 5 P. Cao and S. Irani, "Cost-aware WWW proxy caching algorithms," in Proc. USENIX Syrup. on lnternet Technoloyies and Systems, pp. 193-206, December 1997. http://www, cs. wisc. edu/-cao/papers/gd- size. html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6 S. Williams, M. Abrams, C. R. Standbridge, G. Aty dulla, and E. A. Fox, "Removal policies in network caches for World Wide Web documents," in Proc. A CM SIGCOMM, pp. 293-305, August 1996. http://www, acm. org/s igcomm/s igcomm96/ program.html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. 7 V. Cate, "Alex- A global filesystem," in Proc. USENfX File System Workshop, pp. 1-12, May 1992.]]Google ScholarGoogle Scholar
  8. 8 A. Dingle and T. Partl, "Web cache coherence," in Proc. World Wide Web Conference, May 1996. http: //wwwSconf. inria, fr/f ich_html/papers/P2/ 0verview.html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. 9 S. D. Gribble and E. A. Brewer, "System design issues for Internet middleware services: Deductions from a large client trace," in Proc. USENIX Syrup. on fnternet Technologies and Systems, December 1997. http://www, usenix, org/events/us it s97.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. 10 B. Krishnamurthy and C. E. Wills, "Study of piggyback cache validation for proxy caches in the World Wide Web," in Proc. USENIX Syrup. on Internet Technologies and Systems, pp. 1-12, December 1997. http: //www. research, att. corn/~bala/papers/ pcv-u$ it s97. ps. gz]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. 11 V. N. Padmanabhan and J. C. Mogul, "improving HTTP latency," Computer Networks and ISDN Systems, vol. 28, pp. 25-35, December 1995. http://www.ncsa.uiuc, edu/SDG/IT94/ Proceedings/DDay/mogul/HTTPLat ency. html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. 12 H. F. Nielsen, J. Gettys, A. Baird-Smith, E. Prud'hommeaux, H. W. Lie, and C. Lilley, "Network performance effects of HTTP/1.1, CSS1, and PNG," in Proc. A CM SIGCOMM, pp. 155-166, August 1997. http://www, inria, fr/rodeo/sigcomm97/ program.html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13 J. C. Mogul, "Hinted caching in the Web," in Proc. A CM SIGOPS European Workshop, pp. 129-140, 1996. http://mosqui tonet, stanford, edu/s igops96/ papers/mogul, ps.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. 14 A. Bestavros, "Using speculation to reduce server load and service time on the WWW," in Proc. A CM Inter. Conf. on Information and Knowledge Management, 1995. ht tp: //www. cs. bu. edu/f acul ty/best/res/papers/ Home.html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. 15 V. N. Padmanabhan and J. C. Mogul, "Using predictive prefetching to improve World Wide Web latency," Computer Communication Review, vol. 26, no. 3, pp. 22-36, 1996. ht tp: / / daedalus, c $. berk e 1 e y. edu/pub 1 i c at ions / ccr-july96, ps. gz.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. 16 Z. Jiang and L. Kleinrock, "Prefetching links on the WWW," in Proc. IEEE Inter. Conf. on Communications, pp. 483-489, June 1997. http://millennium, cs. ucla. edu/' j iang/Research/ Publ i cat i on/pre fet ch. ps.]]Google ScholarGoogle Scholar
  17. 17 M. Crovella and P. Barford, "The network effects of prefetching," in Proc. IEEE INFOCOM, pp. 1232-1240, April 1998. http: //www. cs. bu. edu/f aculty/crovella/ papers, html.]]Google ScholarGoogle Scholar
  18. 18 T. M. Kroeger, D. E. Long, and O. C. Mogul, "Exploring the bounds of Web latency reduction from caching and prefetching," in Proc. USENIX Syrnp. on }nternet Technologies and Systems, pp. 13-22, December 1997. http://www, cse. ucsc. edu/~ tmk/ideal, ps.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. 19 C. Liu and P. Cao, "Maintaining strong cache consistency in the World Wide Web," in Proc. IEEE Inter. Conf. on Distributed Computing Systems, pp. 326-334, May 1997. http://www, cs. wisc. edu/-cao/papers/icache, html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. 20 B. Krishnamurthy and C. E. Wills, "Piggyback server invalidation for proxy cache coherency," in Proc. World Wide Web Conference, pp. 185-194, April 1998. http: //www. research, art. com/~bala/papers/ ps i-www7, ps. gz]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. 21 E. Cohen, B. Krishnamurthy, and J. Rexford, "Improving end-to-end performance of the web using server volumes and proxy filters," Tech. Rep. 980206-01, AT&T Labs- Research, February 1998. http://www .research. att. com/~bala/papers/ mafia-tm.ps, gz.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. 22 R. Fielding, J. Gettys, J. C. Mogul, H. Frystyk, and T. Berners-Lee, "Hypertext transfer protocol- HTTP/1.1,', Internet Draft, March 13 1998. This is a work in progress. http://www, w3. org/Prot ocols/HTTP/1.1/ draft - ietf -http-v 11-spec-rev-03. txt.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. 23 J. C. Mogul, F. Douglis, A. Feldmann, and B. Krishna~ murthy, "Potential benefits of delta encoding and data compression for HTTP," in Proc. A CM SIGCOMM, pp. 181-194, August 1997. http://www, inria, fr/rodeo/s igcomm97/ program, html.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. 24 E. Cohen, B. Krishnamurthy, and J. Rexford, "Evaluating server-assisted cache replacement in the web," in Proc. European Symposium on Algorithms, August 1998. http://www, research, art. com/-bala/papers/ esa98, ps. gz]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. 25 F. DougHs, A. Feldmann, B. Krishnamurthy, and J. Mogul, "Rate of change and other metrics: A live study of the World Wide Web," in Proc. USENIX Syrup. on Internet Technologies and Systems, pp. 147- 158, December 1997. http://www .research. art. com/-bala/papers/ roc-usits97.ps.gz]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. 26 M. F. Arlitt and C. L. Williamson, "lnternet Web servers: Workload characterization and implications," iEEE/A CM Trans. on Networking, vol. 5, pp. 631-644, October 1997. ftp: //ftp. cs. usask, ca/pub/discus/ paper. 96- 3. ps. Z.]] Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Summary cache: a scalable wide-area Web cache sharing protocol

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM SIGCOMM Computer Communication Review
          ACM SIGCOMM Computer Communication Review  Volume 28, Issue 4
          Oct. 1998
          311 pages
          ISSN:0146-4833
          DOI:10.1145/285243
          Issue’s Table of Contents
          • cover image ACM Conferences
            SIGCOMM '98: Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication
            October 1998
            328 pages
            ISBN:1581130031
            DOI:10.1145/285237

          Copyright © 1998 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 October 1998

          Check for updates

          Qualifiers

          • article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader