skip to main content
10.1145/1028788.1028795acmconferencesArticle/Chapter ViewAbstractPublication PagesimcConference Proceedingsconference-collections
Article

An analysis of live streaming workloads on the internet

Published:25 October 2004Publication History

ABSTRACT

In this paper, we study the live streaming workload from a large content delivery network. Our data, collected over a 3 month period, contains over 70 million requests for 5,000 distinct URLs from clients in over 200 countries. To our knowledge, this is the most extensive data of live streaming on the Internet that has been studied to date. Our contributions are two-fold. First, we present a macroscopic analysis of the workload, characterizing popularity, arrival process, session duration, and transport protocol use. Our results show that popularity follows a 2-mode Zipf distribution, session interarrivals within small time-windows are exponential, session durations are heavy-tailed, and that UDP is far from having universal reach on the Internet. Second, we cover two additional characteristics that are more specific to the nature of live streaming applications: the diversity of clients in comparison to traditional broadcast media like radio and TV, and the phenomena that many clients regularly join recurring events. We find that Internet streaming does reach a wide audience, often spanning hundreds of AS domains and tens of countries. More interesting is that small streams also have a diverse audience. We also find that recurring users often have lifetimes of at least as long as one-third of the days in the event.

References

  1. J. M. Almeida, J. Krueger, D. L. Eager, and M. K. Vernon. Analysis of Educational Media Server Workloads. In Proceedings of NOSSDAV, June 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. V. Almeida, A. Bestavros, M. Crovella, and A. de Oliveira. Characterizing Reference Locality in the WWW. In Proceedings of 1996 International Conference on Parallel and Distributed Information Systems (PDIS '96), 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. K. C. Almeroth and M. H. Ammar. Collecting and Modeling the Join/Leave Behavior of Multicast Group Members in the MBone. In Proceedings of International Symposium on High Performance Distributed Computing (HPDC), August 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. K. Andreev, B. M. Maggs, A. Meyerson, and R. Sitaraman. Designing Overlay Multicast Networks for Streaming. In Proceedings of the Fifteenth Annual ACM Symposium on Parallel Algorithms and Architectures (SPAA), 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web Caching and Zipf-like Distributions: Evidence and Implications. In Proceedings of the IEEE INFOCOMM '99, March 1999.Google ScholarGoogle ScholarCross RefCross Ref
  6. M. Chesire, A. Wolman, G. Voelker, and H. Levy. Measurement and Analysis of a Streaming-Media Workload. In Proceedings of Usenix Symposium on Internet Technologies and Systems (USITS), March 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. M. Crovella and M. Taqqu. Estimating the Heavy Tail Index from Scaling Properties. In Methodology and Computing in Applied Probability, vol. 1, no. 1, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Cui, M. Faloutsos, D. Maggiorini, M. Gerla, and K. Boussetta. Measuring and Modelling the Group Membership in the Internet. In Proceedings of Interne Measurement Conference (IMC), October 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. C. Cunha, A. Bestavros, and M. Covella. Characteristics of WWWClient Based Traces. Technical Report BU-CS-95-010, Computer Science Department, Boston University, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. Floyd, M. Handley, J. Padhye, and J. Widmer. Multicast Routing in Internetworks and Extended LANs. In Proceedings of the ACM SIGCOMM, August 2000.Google ScholarGoogle Scholar
  11. S. Glassman. A Caching Relay for the World Wide Web. In Proceedings of the First International Conference on the World-Wide Web, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. K. Gummadi, R. Dunn, S. Saroiu, S. Gribble, H. Levy, and J. Zahorjan. Measurement, Modeling, and Analysis of a Peer-to-Peer File-Sharing Workload. In Proceedings of ACM SOSP, October 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. IxMapper. http://www.ixiacom. com/products.Google ScholarGoogle Scholar
  14. B. Krishnamurthy and J. Wang. On Network-Aware Clustering of Web Clients. In Proceedings of ACM SIGCOMM, September 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. T. M. Kroeger, J. C. Mogul, and C. Maltzahn. Digital's web proxy traces. Available at ftp://ftp.digital. com/pub/DEC/traces/proxy/webtraces.html, August 1996.Google ScholarGoogle Scholar
  16. A. Lakhina, J. W. Byers, M. Crovella, and I. Matta. On the Geographic Location of Internet Resources. In IEEE Journaln Selected Areas in Communications Vol. 21 No. 6, Aug 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. MaxMind GeoIP Free Country Database. http://www.maxmind.com/app/geoipcountry.Google ScholarGoogle Scholar
  18. Microsoft Windows Media Services 9 Series and Windows Media Services Version 4. 1 - Performance Comparison. http://www. veritest.com/clients/reports/microsoft/ms media services. pdf.Google ScholarGoogle Scholar
  19. V. N. Padmanabhan, H. J. Wang, P. A. Chou, and K. Sripanidkulchai. Distributing Streaming Media Content Using Cooperative Networking. In Proceedings of NOSSDAV, May 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Route Views Project. http://www.routeviews.org/.Google ScholarGoogle Scholar
  21. K. Sripanidkulchai. A Measurement-Driven Approach to Designing Peer-to-Peer Systems. Ph. D. Thesis, Carnegie Mellon University, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. K. Sripanidkulchai, A. Ganjam, B. Maggs, and H. Zhang. The Feasibility of Supporting Large-Scale Live Streaming Applications with Dynamic Application End-Points. In Proceedings of ACM SIGCOMM, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. E. Veloso, V. Almeida, W. Meira, A. Bestavros, and S. Jin. A Hierarchical Characterization of a Live Streaming Media Workload. In Proceedings of Internet Measurement Workshop (IMW), November 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Y. Wang, M. Claypool, and Z. Zuo. An Empirical Study of RealVideo Performance Across the Internet. In Proceedings of Internet Measurement Workshop (IMW), November 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. An analysis of live streaming workloads on the internet

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        IMC '04: Proceedings of the 4th ACM SIGCOMM conference on Internet measurement
        October 2004
        386 pages
        ISBN:1581138210
        DOI:10.1145/1028788

        Copyright © 2004 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 October 2004

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • Article

        Acceptance Rates

        Overall Acceptance Rate277of1,083submissions,26%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader