Skip to main content

From Packets to People: Quality of Experience as a New Measurement Challenge

  • Chapter
Data Traffic Monitoring and Analysis

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 7754))

Abstract

Over the course of the last decade, the concept of Quality of Experience (QoE) has gained strong momentum, both from an academic research and an industry perspective. Being linked very closely to the subjective perception of the end user, QoE is supposed to enable a broader, more holistic understanding of the qualitative performance of networked communication systems and thus to complement the traditional, more technology-centric Quality of Service (QoS) perspective.

The purpose of this chapter is twofold: firstly, it introduces the reader to QoE by discussing the origins and the evolution of the concept. Secondly, it provides an overview of the current state of the art of QoE research, with focus on work that particularly addresses QoE as a measurement challenge on the technology as well as on the end-user level. This is achieved by surveying the different streams of QoE research that have emerged in the context of Video, Voice and Web services with respect to the following aspects: fundamental relationships and perceptual principles, QoE assessment, modeling and monitoring.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Al-Akhras, M., Zedan, H., John, R., Al-Momani, I.: Non-intrusive speech quality prediction in voip networks using a neural network approach. Neurocomputing 72(10-12), 2595–2608 (2009), http://www.sciencedirect.com/science/article/B6V10-4V1TXP7-1/2/c089682667034eb3874ab651e69e21c1 ; Lattice Computing and Natural Computing (JCIS 2007) / Neural Networks in Intelligent Systems Designn (ISDA 2007)

  2. Allan, L.G.: The perception of time. Attention, Perception, & Psychophysics 26(5), 340–354 (1979)

    Article  Google Scholar 

  3. Anderson, C.: TED Talks: How web video powers global innovation, http://www.ted.com/talks/chris_anderson_how_web_video_powers_global_innovation.html

  4. Andrews, M., Cao, J., McGowan, J.: Measuring human satisfaction in data networks. In: Proceedings of INFOCOM 2006. IEEE (2006)

    Google Scholar 

  5. Antonides, G., Verhoef, P.C., van Aalst, M.: Consumer perception and evaluation of waiting time: A field experiment. Journal of Consumer Psychology 12(3), 193–202 (2002)

    Article  Google Scholar 

  6. Bech, S., Zacharov, N.: Perceptual Audio Evaluation - Theory, Method and Application. Wiley (July 2006)

    Google Scholar 

  7. Beerends, J.G., Hekstra, A.P., Hollier, M.P., Rix, A.W.: Perceptual Evaluation of Speech Quality (PESQ)-The New ITU Standard for End-to-End Speech Quality Assessment Part II-Psychoacoustic Model. Journal of the Audio Engineering Society 50(10), 765–778 (2002)

    Google Scholar 

  8. Belshe, M.: More Bandwidth does not Matter (much). Tech. rep., Google (2010)

    Google Scholar 

  9. Bhatti, N., Bouch, A., Kuchinsky, A.: Integrating User-Perceived quality into web server design. In: 9th International World Wide Web Conference, pp. 1–16 (2000)

    Google Scholar 

  10. Bjorksten, M., Pohjola, O.P., Kilkki, K.: Applying user segmentation and estimating user value in techno-economic modeling. In: 6th Conference on Telecommunication Techno-Economics, CTTE 2007, pp. 1–6 (2007)

    Google Scholar 

  11. Boev, A., Poikela, M., Gotchev, A., Aksay, A.: Modelling of the stereoscopic hvs. Tech. rep., Mobile3DTV Project, http://sp.cs.tut.fi/mobile3dtv/results/tech/D5.3_Mobile3DTV_v2.0.pdf

  12. Bouch, A., Sasse, M.A., DeMeer, H.G.: Of packets and people: a user-centered approach to quality of service. In: Proceedings of IWQoS 2000 (2000)

    Google Scholar 

  13. Bouch, A., Kuchinsky, A., Bhatti, N.: Quality is in the eye of the beholder: meeting users’ requirements for internet quality of service. In: CHI 2000: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 297–304. ACM, New York (2000)

    Chapter  Google Scholar 

  14. Van den Broeck, W., Jacobs, A., Staelens, N.: Integrating the everyday-life context in subjective video quality experiments. In: 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), pp. 19–24 (July 2012)

    Google Scholar 

  15. Brooks, P., Hestnes, B.: User measures of quality of experience: why being objective and quantitative is important. IEEE Network 24(2), 8–13 (2010)

    Article  Google Scholar 

  16. Buchinger, S., Robitza, W., Hummelbrunner, P., Nezveda, M., Sack, M., Hlavacs, H.: Slider or glove? proposing an alternative quality rating methodology. In: VPQM 2010 (2010), http://eprints.cs.univie.ac.at/93/

  17. Callet, P.L., Möller, S.: Perkis (eds), A.: Qualinet white paper on definitions of quality of experience (June 2012)

    Google Scholar 

  18. Chen, K.T., Chang, C.J., Wu, C.C., Chang, Y.C., Lei, C.L.: Quadrant of euphoria: a crowdsourcing platform for QoE assessment. IEEE Network 24(2), 28–35 (2010)

    Article  Google Scholar 

  19. Chen, W., Fournier, J., Barkowsky, M., Callet, P.L.: New requirements of subjective video quality assessment methodologies for 3dtv. In: VPQM 2010 (2010)

    Google Scholar 

  20. Clark, A.: Modeling the effects of burst packet loss and recency on subjective voice quality. In: Internet Telephony Workshop, New York (April 2001), http://www.cs.columbia.edu/~hgs/papers/iptel2001/21.pdf

  21. Collange, D., Costeux, J.L.: Passive estimation of quality of experience. Journal of Universal Computer Science 14(5), 625–641 (2008)

    Google Scholar 

  22. Crawley, E., Nair, R., Rajagopalan, B., Sandick, H.: RFC 2386: A Framework for QoS-based Routing in the Internet. Tech. rep., IETF (August 1998), http://www.ietf.org/rfc/rfc2386.txt

  23. Cui, H., Biersack, E.: Trouble shooting interactive web sessions in a home environment, p. 25. ACM Press (2011), http://64.238.147.56/citation.cfm?id=2018567.2018574&coll=DL&dl=GUIDE&CFID=103748494&CFTOKEN=26870697

  24. Daly, S.: The visible differences predictor: an algorithm for the assessment of image fidelity. In: Digital images and Human Vision, pp. 179–206. MIT Press, Cambridge (1993)

    Google Scholar 

  25. Dobrian, F., Sekar, V., Awan, A., Stoica, I., Joseph, D., Ganjam, A., Zhan, J., Zhang, H.: Understanding the impact of video quality on user engagement. In: Proceedings of the ACM SIGCOMM 2011 Conference (SIGCOMM 2011), pp. 362–373. ACM, New York (2011), http://doi.acm.org/10.1145/2018436.2018478

    Chapter  Google Scholar 

  26. Egger, S., Reichl, P., Hoßfeld, T., Schatz, R.: ’Time is Bandwidth’? Narrowing the Gap between Subjective Time Perception and Quality of Experience. In: IEEE ICC 2012 - Communication QoS, Reliability and Modeling Symposium (ICC 2012 CQRM), Ottawa, Ontario, Canada (June 2012)

    Google Scholar 

  27. Egger, S., Schatz, R., Scherer, S.: It Takes Two to Tango - Assessing the Impact of Delay on Conversational Interactivity on Perceived Speech Quality. In: INTERSPEECH, pp. 1321–1324 (2010)

    Google Scholar 

  28. Egger, S., Schatz, R., Schoenenberg, K., Raake, A., Kubin, G.: Same but Different? - Using Speech Signal Features for Comparing Conversational VoIP Quality Studies. In: IEEE ICC 2012 - Communication QoS, Reliability and Modeling Symposium (ICC 2012 CQRM), Ottawa, Ontario, Canada (June 2012)

    Google Scholar 

  29. Eisler, H.: Subjective duration and psychophysics. Psychological Review 82(6), 429–450 (1975)

    Article  Google Scholar 

  30. Elert, G.: Wavelength of maximum human visual sensitivity, http://hypertextbook.com/facts/2007/SusanZhao.shtml

  31. Fiedler, M.: EuroNGI deliverable D.WP.JRA.6.1.1: state of the art with regards to user perceived quality of service and quality feedback. Tech. rep. (May 2004), http://eurongi.enst.fr

  32. Fiedler, M., Hoßfeld, T., Tran-Gia, P.: A generic quantitative relationship between quality of experience and quality of service. Netwrk. Mag. of Global Internetwkg 24, 36–41 (2010)

    Article  Google Scholar 

  33. Garcia, M.N., Raake, A., List, P.: Towards content-related features for parametric video quality prediction of IPTV services, pp. 757–760 (2008)

    Google Scholar 

  34. Garcia, M.N., Raake, A.: Frame-layer packet-based parametric video quality model for encrypted video in IPTV services. In: QoMEX 2011, pp. 102–106 (2011)

    Google Scholar 

  35. Gomez, G., Sanchez, R.: End-to-End Quality of Service Over Cellular Networks: Data Services Performance and Optimization in 2g/3g. John Wiley (July 2005)

    Google Scholar 

  36. Gozdecki, J., Jajszczyk, A., Stankiewicz, R.: Quality of service terminology in IP networks. IEEE Communications Magazine 41(3), 153–159 (2003)

    Article  Google Scholar 

  37. Grondin, S.: From physical time to the first and second moments of psychological time. Psychological Bulletin 127(1), 22–44 (2001)

    Article  Google Scholar 

  38. Grondin, S.: Sensory modalities and temporal processing. In: Helfrich, H. (ed.) Time and mind II: information processing perspectives. Hogrefe & Huber (2003)

    Google Scholar 

  39. Grondin, S.: Timing and time perception: a review of recent behavioral and neuroscience findings and theoretical directions. Attention Perception Psychophysics 72(3), 561–582 (2010)

    Article  Google Scholar 

  40. Hands, D., Wilkins, M.: A Study of the Impact of Network Loss and Burst Size on Video Streaming Quality and Acceptability. In: Díaz, M., Sénac, P. (eds.) IDMS 1999. LNCS, vol. 1718, pp. 45–57. Springer, Heidelberg (1999), http://www.springerlink.com/content/21u2413r58534l52/abstract/

    Chapter  Google Scholar 

  41. Hogarth, R.M.: Judgement and choice: the psychology of decision. J. Wiley (1980)

    Google Scholar 

  42. Höldtke, K., Raake, A., Möller, S., Egger, S., Schatz, R., Rohrer, N.: How the Need for fast Interaction affects the Impact of Transmission Delay on the overall Quality Judgment. Tech. rep., ITU-T, Geneva, Switzerland (January 2011)

    Google Scholar 

  43. Hoßfeld, T., Hock, D., Tran-Gia, P., Tutschku, K., Fiedler, M.: Testing the IQX Hypothesis for Exponential Interdependency between QoS and QoE of Voice Codecs iLBC and G.711. Tech. Rep. 442, University of Wuerzburg (March 2008)

    Google Scholar 

  44. Hoßfeld, T., Schatz, R., Biedermann, S., Platzer, A., Egger, S., Fiedler, M.: The Memory Effect and Its Implications on Web QoE Modeling. In: 23rd International Teletraffic Congress (ITC 2011), San Francisco, USA (September 2011)

    Google Scholar 

  45. Hoßfeld, T., Schatz, R., Seufert, M., Hirth, M., Zinner, T., Tran-Gia, P.: Quantification of YouTube QoE via Crowdsourcing. In: IEEE International Workshop on Multimedia Quality of Experience - Modeling, Evaluation, and Directions (MQoE 2011), Dana Point, CA, USA (December 2011)

    Google Scholar 

  46. Hoßfeld, T., Schatz, R., Varela, M., Timmerer, C.: Challenges of QoE Management for Cloud Applications. IEEE Communications Magazine (April 2012)

    Google Scholar 

  47. Hoßfeld, T., Tran-Gia, P., Fiedler, M.: Quantification of quality of experience for edge-based applications. In: 20th International Teletraffic Congress (ITC 20), Ottawa, Canada (June 2007)

    Google Scholar 

  48. Hu, J., Wildfeuer, H.: Use of content complexity factors in video over ip quality monitoring. In: 2009 International Workshop on Quality of Multimedia Experience, pp. 216–221 (2009)

    Google Scholar 

  49. Huynh-Thu, Q., Garcia, M., Speranza, F., Corriveau, P., Raake, A.: Study of rating scales for subjective quality assessment of High-Definition video. IEEE Transactions on Broadcasting 57(1), 1–14 (2011)

    Article  Google Scholar 

  50. Ibarrola, E., Liberal, F., Taboada, I., Ortega, R.: Web qoe evaluation in multi-agent networks: Validation of itu-t g.1030. In: ICAS 2009: Proceedings of the 2009 Fifth International Conference on Autonomic and Autonomous Systems, pp. 289–294. IEEE Computer Society, Washington, DC (2009)

    Chapter  Google Scholar 

  51. International Telecommunication Union: Handbook on Telephonometry, ITU-T (July 1992)

    Google Scholar 

  52. International Telecommunication Union: Terms and definitions related to quality of service and network performance including dependibility. ITU-T Recommendation E.800 (August 1994)

    Google Scholar 

  53. International Telecommunication Union: End-user multimedia QoS categories. ITU-T Recommendation G.1010 (November 2001)

    Google Scholar 

  54. International Telecommunication Union: Analysis and interpretation of INMD voice-service measurements. ITU-T Recommendation P.562 (May 2004)

    Google Scholar 

  55. International Telecommunication Union: Estimating end-to-end performance in ip networks for data applications. ITU-T Recommendation G.1030 (November 2005)

    Google Scholar 

  56. International Telecommunication Union: Vocabulary and effects of transmission parameters on customer opinion of transmission quality, amendment 2. ITU-T Recommendation P.10/G.100 (2006)

    Google Scholar 

  57. International Telecommunication Union: H.264: Advanced video coding for generic audiovisual services. Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services - Coding of moving video (November 2007)

    Google Scholar 

  58. International Telecommunication Union: Subjective Evaluation of Conversational Quality. ITU-T Recommendation P.805 (July 2007)

    Google Scholar 

  59. Ito, Y., Tasaka, S.: Quantitative assessment of user-level QoS and its mapping. IEEE Transactions on Multimedia 7(3), 572–584 (2005)

    Article  Google Scholar 

  60. ITU-T Study Group 2: Teletraffic Engineering Handbook. ITU (2005)

    Google Scholar 

  61. Janowski, L., Papir, Z.: Modeling subjective tests of quality of experience with a generalized linear model. In: QoMEX 2009, First International Workshop on Quality of Multimedia Experience, California, San Diego (July 2009)

    Google Scholar 

  62. Jekosch, U.: Voice and Speech Quality Perception: Assessment and Evaluation. Signals and Communication Technology. Springer (2005), http://books.google.at/books?id=Ef3lHiSzq1QC

  63. Kanumuri, S., Cosman, P., Reibman, A., Vaishampayan, V.: Modeling packet-loss visibility in MPEG-2 video. IEEE Transactions on Multimedia 8(2), 341–355 (2006)

    Article  Google Scholar 

  64. Kawano, T., Yamagishi, K.: Performance evaluation of subjective quality assessment methods for stereoscopic video services, ftp://vqeg.its.bldrdoc.gov/Documents/VQEG_Hillsboro_Dec11/MeetingFiles/VQEG_3DTV_2011_037_Performance%20Evaluation%20of%203D%20Assessment%20MethodsNTT.doc

  65. Khirman, S., Henriksen, P.: Relationship between Quality-of-Service and quality-of- experience for public internet service. In: Proceedings of the 3rd Workshop on Passive and Active Measurement, Fort Collins, Colorado, USA (March 2002)

    Google Scholar 

  66. Killeen, P.R., Weiss, N.A.: Optimal timing and the weber function. Psychological Review 94(4), 455–468 (1987)

    Article  Google Scholar 

  67. Kim, D.S., Tarraf, A.: Anique+: A new american national standard for non-intrusive estimation of narrowband speech quality: Research articles. Bell Lab. Tech. J. 12(1), 221–236 (2007), http://dx.doi.org/10.1002/bltj.v12:1

    Article  Google Scholar 

  68. King, A.: Speed Up Your Site: Web Site Optimization. New Riders, Indianapolis (2003)

    Google Scholar 

  69. Knoche, H., De Meer, H., Kirsh, D.: Utility curves: mean opinion scores considered biased. In: 1999 Seventh International Workshop on Quality of Service, IWQoS 1999, pp. 12–14 (1999)

    Google Scholar 

  70. Knoche, H.O.: Quality of experience in digital mobile multimedia services (July 2011), http://discovery.ucl.ac.uk/1322706/

  71. Kumar, V.: Managing Customers for Profit: Strategies to Increase Profits and Build Loyalty. Pearson Prentice Hall (2008)

    Google Scholar 

  72. Laghari, K., Crespi, N., Connelly, K.: Toward total quality of experience: A QoE model in a communication ecosystem. IEEE Communications Magazine 50(4), 58–65 (2012)

    Article  Google Scholar 

  73. Malfait, L., Berger, J., Kastner, M.: P.563 - The ITU-T Standard for Single-Ended Speech Quality Assessment. IEEE Transactions on Audio, Speech & Language Processing 14(6), 1924–1934 (2006)

    Article  Google Scholar 

  74. Mandryk, R.L., Inkpen, K.M., Calvert, T.W.: Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & IT 25(2), 141–158 (2006)

    Google Scholar 

  75. Möller, S., Berger, J., Raake, A., Waltermann, M., Weiss, B.: A new dimension-based framework model for the quality of speech communication services. In: 2011 Third International Workshop on Quality of Multimedia Experience (QoMEX), pp. 107–112 (September 2011)

    Google Scholar 

  76. Möller, S., Berger, J., Raake, A., Wältermann, M., Weiss, B.: A new dimension-based framework model for the quality of speech communication services. In: 2011 Third International Workshop on Quality of Multimedia Experience (QoMEX), pp. 107–112 (September 2011)

    Google Scholar 

  77. Möller, S., Chan, W., Cote, N., Falk, T., Raake, A., Wältermann, M.: Speech quality estimation: Models and trends. IEEE Signal Processing Magazine 28(6), 18–28 (2011)

    Article  Google Scholar 

  78. Möller, S.: Assessment and Prediction of Speech Quality in Telecommunications, 1st edn. Springer (August 2000)

    Google Scholar 

  79. Möller, S.: Quality Engineering - Qualität kommunikationstechnischer Systeme. Springer (2010)

    Google Scholar 

  80. Möller, S., Raake, A.: Telephone speech quality prediction: towards network planning and monitoring models for modern network scenarios. Speech Communication 38, 47–75 (2002), http://portal.acm.org/citation.cfm?id=638078.638082 , ACM ID: 638082

    Google Scholar 

  81. Moor, K.D., Ketyko, I., Joseph, W., Deryckere, T., Marez, L.D., Martens, L., Verleye, G.: Proposed framework for evaluating quality of experience in a mobile, testbed-oriented living lab setting. Mobile Networks and Applications 15(3), 378–391 (2010), http://www.springerlink.com/index/10.1007/s11036-010-0223-0

    Article  Google Scholar 

  82. Moorsel, A.V.: Metrics for the internet age: Quality of experience and quality of business. Tech. rep., 5th Performability Workshop (2001), http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.24.3810

  83. Nielsen, J.: Usability Engineering. Morgan Kaufmann Publishers, San Francisco (1993)

    MATH  Google Scholar 

  84. Niida, S., Uemura, S., Nakamura, H.: Mobile services. IEEE Vehicular Technology Magazine 5(3), 61–67 (2010)

    Article  Google Scholar 

  85. Nokia: Quality of experience (QoE) of mobile services - can it be measured and improved? (2004)

    Google Scholar 

  86. O’Shaughnessy, D.: Speech communications: human and machine, vol. 37. IEEE Press (2000), http://www.ncbi.nlm.nih.gov/pubmed/11442089

  87. Olshefski, D., Nieh, J.: Understanding the management of client perceived response time. In: Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems, pp. 240–251 (2006)

    Google Scholar 

  88. Osaka, N., Kakehi, K., Iai, S., Kitawaki, N.: A model for evaluating talker echo and sidetone in a telephone transmission network. IEEE Transactions on Communications 40(11), 1684–1692 (1992)

    Article  Google Scholar 

  89. Pescapè, A., Salgarelli, L., Dimitropoulos, X. (eds.): TMA 2012. LNCS, vol. 7189. Springer, Heidelberg (2012)

    Google Scholar 

  90. Pine, B.J., Gilmore, J.H.: The Experience Economy: Work is Theatre & Every Business a Stage. Harvard Business Press (April 1999)

    Google Scholar 

  91. Pinson, M., Wolf, S.: Comparing subjective video quality testing methodologies. In: SPIE Video Communications and Image Processing Conference, pp. 8–11 (2003)

    Google Scholar 

  92. Pinson, M.H., Janowski, L., Pepion, R., Huynh-Thu, Q., Schmidmer, C., Corriveau, P., Younkin, A., Le Callet, P., Barkowsky, M., Ingram, W.: The influence of subjects and environment on audiovisual subjective tests: An international study. IEEE Journal of Selected Topics in Signal Processing 6(6), 640–651 (2012)

    Article  Google Scholar 

  93. Pinson, M., Speranza, F.: Report on the validation of video quality models for high definition video content, http://www.its.bldrdoc.gov/media/4212/vqeg_hdtv_final_report_version_2.0.zip

  94. Pinson, M., Thorpe, L., Cermak, G.: Test plan for evaluation of video quality models for use with high definition tv content, http://www.its.bldrdoc.gov/media/5871/vqeg_hdtv_testplan_v3_1.doc

  95. Raake, A.: Short- and Long-Term Packet Loss Behavior: Towards Speech Quality Prediction for Arbitrary Loss Distributions. IEEE Transactions on Audio, Speech, and Language Processing 14(6), 1957–1968 (2006)

    Article  Google Scholar 

  96. Raake, A., Garcia, M., Möller, S., Berger, J., Kling, F., List, P., Johann, J., Heidemann, C.: T-V-model: parameter-based prediction of IPTV quality. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008, pp. 1149–1152 (2008)

    Google Scholar 

  97. Raake, A.: Speech Quality of VoIP: Assessment and Prediction. John Wiley & Sons (2006)

    Google Scholar 

  98. Reichelt, S., Haussler, R., Fütterer, G., Leister, N.: Most 7690(0), 76900B–76900B–12 (2010)

    Google Scholar 

  99. Reichl, P., Egger, S., Schatz, R., D’Alconzo, A.: The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment. In: Proceedings of the 2010 IEEE International Conference on Communications, pp. 1–5 (May 2010)

    Google Scholar 

  100. Reichl, P.: From charging for quality of service to charging for quality of experience. Annales des Télécommunications 65(3-4), 189–199 (2010)

    Article  Google Scholar 

  101. Reichl, P., Tuffin, B., Schatz, R.: Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience. Telecommunication Systems, 1–14 (2011)

    Google Scholar 

  102. Richards, D.: Calculation of opinion scores for telephone connections. Proceedings of the Institution of Electrical Engineers 121(5), 313–323 (1974)

    Article  Google Scholar 

  103. Rix, A.W., Beerends, J.G., Hollier, M.P., Hekstra, A.P.: Perceptual evaluation of speech quality (PESQ): the new ITU standard for end-to-end speech quality assessment - Part I: time-delay compensation. Journal of the Audio Engineering Society 50(10), 755–764 (2002)

    Google Scholar 

  104. Rubino, G.: Quantifying the quality of audio and video transmissions over the internet: the PSQA approach. In: Design and Operations of Communication Networks: A Review of Wired and Wireless Modelling and Management Challenges. Imperial College Press (2005)

    Google Scholar 

  105. Schatz, R., Egger, S.: Vienna Surfing - Assessing Mobile Broadband Quality in the Field. In: Taft, N., Wetherall, D. (eds.) Proceedings of the 1st ACM SIGCOMM Workshop on Measurements Up the STack (W-MUST). ACM (2011)

    Google Scholar 

  106. Schatz, R., Egger, S., Platzer, A.: Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services. In: Proceedings of the 2011 IEEE International Conference on Communications, pp. 1–6 (June 2011)

    Google Scholar 

  107. Schatz, R., Egger, S., Platzer, A.: Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services. In: International Conference on Communications (2011)

    Google Scholar 

  108. Seow, S.C.: Designing and Engineering Time: The Psychology of Time Perception in Software. Addison-Wesley Professional (2008)

    Google Scholar 

  109. Shaikh, J., Fiedler, M., Collange, D.: Quality of experience from user and network perspectives. Annals of Telecommunications 65, 47–57 (2010), http://dx.doi.org/10.1007/s12243-009-0142-x , 10.1007/s12243-009-0142-x

    Google Scholar 

  110. Siller, M., Woods, J.C.: QoS arbitration for improving the QoE in multimedia transmission. In: International Conference on Visual Information Engineering, VIE 2003, pp. 238–241 (2003)

    Google Scholar 

  111. da Silva, A.P.C., Varela, M., de Souza e Silva, E., Leäo, R.M.M., Rubino, G.: Quality assessment of interactive voice applications. Comput. Netw. 52(6), 1179–1192 (2008)

    Article  Google Scholar 

  112. Skadberg, Y.X., Kimmel, J.R.: Visitors’ flow experience while browsing a Web site: its measurement, contributing factors and consequences. Computers in Human Behavior 20, 403–422 (2004)

    Article  Google Scholar 

  113. Soldani, D., Li, M., Cuny, R.: QoS and QoE management in UMTS cellular systems. John Wiley and Sons (August 2006)

    Google Scholar 

  114. Staelens, N., Sedano, I., Barkowsky, M., Janowski, L., Brunnstrom, K., Callet, P.L.: Standardized toolchain and model development for video quality assessment - the mission of the joint effort group in vqeg. In: 2011 Third International Workshop on Quality of Multimedia Experience Quality of Multimedia Experience (QoMEX), Belgium, pp. 17–22 (September 2011)

    Google Scholar 

  115. Stankiewicz, R., Jajszczyk, A.: A survey of qoe assurance in converged networks. Computer Networks 55(7), 1459–1473 (2011)

    Article  Google Scholar 

  116. Stevens, S.S.: On the Psychophysical Law. Psychology Revue 64(3), 153–181 (1957)

    Article  Google Scholar 

  117. Strohmeier, D., Jumisko-Pyykk, S., Kunze, K.: Open profiling of quality: A mixed method approach to understanding multimodal quality perception. In: Advances in Multimedia 2010, pp. 1–28 (2010), http://www.hindawi.com/journals/am/2010/658980/abs/

  118. Sun, L., Ifeachor, E.: Voice quality prediction models and their application in voip networks. IEEE Transactions on Multimedia 8(4), 809–820 (2006)

    Article  Google Scholar 

  119. Takahashi, A.: Opinion model for estimating conversational quality of voip. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2004, vol. 3, pp. 1072–1075 (May 2004)

    Google Scholar 

  120. Takahashi, A., Kurashima, A., Yoshino, H.: Objective assessment methodology for estimating conversational quality in voip. IEEE Transactions on Audio, Speech, and Language Processing 14(6), 1984–1993 (2006)

    Article  Google Scholar 

  121. Thakolsri, S., Kellerer, W., Steinbach, E.G.: Qoe-based cross-layer optimization of wireless video with unperceivable temporal video quality fluctuation. In: ICC, pp. 1–6. IEEE (2011), http://dblp.uni-trier.de/db/conf/icc/icc2011.html#ThakolsriKS11

  122. Varela, M.: Pseudo-subjective Quality Assessment of Multimedia Streams and its Applications in Control. PhD thesis, University of Rennes 1, France (2005)

    Google Scholar 

  123. Wältermann, M., Raake, A., Möller, S.: Quality Dimensions of Narrowband and Wideband Speech Transmission. Acta Acustica united with Acustica 96(6) (2010), http://dx.doi.org/10.3813/AAA.918370

  124. Wang, Y.: Survey of objective video quality measurements. Quality, pp. 1–7 (2006)

    Google Scholar 

  125. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)

    Article  Google Scholar 

  126. Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement (February 2004)

    Google Scholar 

  127. Weber, E.H.: De Pulsu, Resorptione, Auditu Et Tactu. Annotationes Anatomicae Et Physiologicae. Koehler, Leipzig (1834)

    Google Scholar 

  128. Weinreich, H., Obendorf, H., Herder, E., Mayer, M.: Not quite the average: An empirical study of web use. ACM Transactions on the Web (TWEB) 2(1), 1–31 (2008)

    Article  Google Scholar 

  129. Wilson, G.M., Sasse, M.A.: Do Users Always Know What’s Good For Them? Utilising Physiological Responses to Assess Media Quality. In: The Proceedings of HCI 2000: People and Computers XIV - Usability or Else (HCI 2000), pp. 327–339. Springer (2000)

    Google Scholar 

  130. Winkler, S., Mohandas, P.: The evolution of video quality measurement: From PSNR to hybrid metrics. IEEE Transactions on Broadcasting 54(3), 660–668 (2008), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4550731

    Article  Google Scholar 

  131. Winkler, S.: Issues in vision modeling for perceptual video quality assessment. Signal Processing 78(2), 231–252 (1999), http://www.sciencedirect.com/science/article/pii/S0165168499000626

    Article  MATH  Google Scholar 

  132. Winkler, S.: Video quality measurement standards: current status and trends. In: Proceedings of the 7th International Conference on Information, Communications and Signal Processing, ICICS 2009, pp. 848–852. IEEE Press, Piscataway (2009)

    Google Scholar 

  133. Wolf, S., Pinson, M.: NTIA Report 02-392: Video Quality Measurement Techniques. Tech. rep., Institute for Telecommunication Sciences, http://www.its.bldrdoc.gov/pub/ntia-rpt/02-392/

  134. Xue, J., Chen, C.W.: A study on perception of mobile video with surrounding contextual influences. In: 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), pp. 248–253 (July 2012)

    Google Scholar 

  135. Zepernick, H., Engelke, U.: Quality of experience of multimedia services: Past, Present, and Future. ACM, Lisbon (2011), http://www.bth.se/fou/forskinfo.nsf/all/bb7dbb41bc492428c12578f7003d6bfb

    Google Scholar 

  136. Zhang, J., Ansari, N.: On assuring end-to-end qoe in next generation networks: challenges and a possible solution. IEEE Communications Magazine 49(7), 185–191 (2011), http://dblp.uni-trier.de/db/journals/cm/cm49.html#ZhangA11a

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Schatz, R., Hoßfeld, T., Janowski, L., Egger, S. (2013). From Packets to People: Quality of Experience as a New Measurement Challenge. In: Biersack, E., Callegari, C., Matijasevic, M. (eds) Data Traffic Monitoring and Analysis. Lecture Notes in Computer Science, vol 7754. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36784-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-36784-7_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-36783-0

  • Online ISBN: 978-3-642-36784-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics