Skip to main content
SpringerLink
Log in

Analysis of the quality of experience of a commercial voice-over-IP service

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Voice-over-IP (VoIP) services, enabling users to make cheap phone calls using the Internet, are becoming increasingly popular, not only on desktop computers but also on mobile devices such as smartphones that are connected through mobile networks. Users’ perception of the level of quality plays a key role in making a VoIP service to succeed or to fail. This paper demonstrates the influence of technical parameters (such as the audio codec, type of data network, and handovers during the call), device characteristics (such as the platform, manufacturer, model, and operating system), and application aspects (such as the software version and configuration) on the subjective quality of a commercial VoIP service. The relative influence of all these parameters is determined and a decision tree combines these results in order to assess the subjective quality. Combining a large number of objective parameters in a decision tree to determine the user’s subjective evaluation of the quality of a VoIP call is a novel and complex procedure. The subjective quality, in turn, has an influence on the duration of the call, and as a result an influence on the usage behavior of the service. The users’ assessment of the service quality is not evaluated by merely taking a snapshot of the perceived quality at one moment in time but rather by analyzing the perceived quality over a longer period of time during service usage, which has not been done up to now. Analyzing the VoIP service using a regression analysis over a period of 120 days showed that the perceived quality decreases slightly when the user utilizes the service more often and gets more familiar with it.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. http://www.skype.com

  2. http://www.oovoo.com

  3. http://www.google.com/hangouts

  4. http://www.vikingtalk.com

  5. http://www.mobilevikings.com

  6. http://www-01.ibm.com/software/analytics/spss

References

  1. About.com: What affects voice quality in VoIP calls (2013) Available at http://voip.about.com/od/voipbasics/a/factorsquality.htm. Accessed 5 July 2013

  2. Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and regression trees, 1st edn. Chapman and Hall/CRC

  3. Cano MD, Cerdan F (2012) Subjective qoe analysis of voip applications in a wireless campus environment. Telecommun Syst 49(1):5–15. doi:10.1007/s11235-010-9348-5

    Article  Google Scholar 

  4. Cardeal S, Neves F, Soares S, Tavares F, Assuncao P (2011) Arqos Ⓡ: system to monitor qos/qoe in voip. In: EUROCON - international conference on computer as a tool (EUROCON), 2011 IEEE, pp. 1–2. doi:10.1109/EUROCON.2011.5929310

  5. Definition of Quality of Experience (QoE) (2007) Liaison statement, ITU-T, International Telecommunication Union. Ref.: TD 109 rev 2 (PLEN/12)

  6. De Pessemier T, De Moor K, Joseph W, De Marez L, Martens L (2012) Quantifying subjective quality evaluations for mobile video watching in a semi-living lab context. IEEE Trans Broadcast 58(4):80–589. doi:10.1109/TBC.2012.2199590

    Google Scholar 

  7. De Pessemier T, De Moor K, Ketykó I, Joseph W, De Marez L, Martens L (2012) Investigating the influence of qos on personal evaluation behaviour in a mobile context. Multimedia Tools Appl 57(2):335–358. doi:10.1007/s11042-010-0712-y

    Article  Google Scholar 

  8. Geerts D, De Moor K, Ketykó I, Jacobs A, Van den Bergh J, Joseph W, Martens L, De Marez L (2010) Linking an integrated framework with appropriate methods for measuring qoe. In: 2010 Second international workshop on quality of multimedia experience (QoMEX), pp. 158–163. doi:10.1109/QOMEX.2010.5516292

  9. Hoßfeld T, Binzenhöfer A (2008) Analysis of skype voip traffic in umts: end-to-end qos and qoe measurements. Comput Net 52(3):650–666. doi:10.1016/j.comnet.2007.10.008, http://www.sciencedirect.com/science/article/pii/S138912860700299X

    Article  MATH  Google Scholar 

  10. Huang TY, Huang P, Chen KT, Wang PJ (2010) Could skype be more satisfying? a qoe-centric study of the fec mechanism in an internet-scale voip system. Net IEEE 24(2):42–48. doi: 10.1109/MNET.2010.5430143

    Article  Google Scholar 

  11. Imam I, Michalski R (1993) Learning decision trees from decision rules: a method and initial results from a comparative study. J Intell Inf Syst 2(3):279–304. doi:10.1007/BF00962072

    Article  Google Scholar 

  12. Karapanos E, Zimmerman J, Forlizzi J, Martens JB (2009) User experience over time: an initial framework. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’09. ACM, New York. pp. 729–738. doi:10.1145/1.5187011518814

  13. Kutner MH, Nachtsheim CJ, Neter J, Li W (2005) Applied linear statistical models, 5th edn. McGraw-Hill

  14. Magidson J (1994) The chaid approach to segmentation modeling: chi-squared automatic interaction detection. In: Bagozzi RP (ed) Advanced methods of marketing research. Blackwell, Oxford, pp 118–159

    Google Scholar 

  15. Manousos M, Apostolacos S, Grammatikakis I, Mexis D, Kagklis D, Sykas E (2005) Voice-quality monitoring and control for voip. IEEE Internet Comput 9(4):35–42. doi:10.1109/MIC.2005.92

    Article  Google Scholar 

  16. Nováková L, Štepánková O (2011) Visualization of trends using radviz. J Intell Inf Syst 3(3):355–369. doi:10.1007/s10844-011-0157-4

    Article  Google Scholar 

  17. Palmieri F (2006) Large scale voice over ip experiences on high performance intranets. In: Chaudhuri S, Das S, Paul H, Tirthapura S (eds) Distributed computing and networking, lecture notes in computer science, vol 4308. Springer, Berlin, pp 355–366

    Google Scholar 

  18. Rajaraman S (2009) Five stars dominate ratings. YouTube official blog. Available at http://youtube-global.blogspot.be/2009/09/five-stars-dominate-ratings.html. Accessed 15 July 2013

  19. Reiter U (2011) Overall perceived audiovisual quality - what people pay attention to. In: IEEE 15th international symposium on consumer electronics 2011 (ISCE), pp 513–517. doi:10.1109/ISCE.2011.5973883

  20. Rowe LA, Jain R (2005) Acm sigmm retreat report on future directions in multimedia research. ACM Trans Multimed Comput Commun Appl 1(1):3–13. doi:10.1145/1.0479361047938

    Article  Google Scholar 

  21. Soldani D, Li M, Cuny R (2006) QoS and QoE management in UMTS cellular systems, pp i–xxvii. Wiley

  22. Support BA (2013) The growing popularity of hosted VoIP. Available at http://www.advisorysupport.co.uk/the-growing-popularity-of-hosted-voip/. Accessed 5 July 2013

Download references

Author information

Authors and Affiliations

  1. Department of Information Technology, iMinds - Ghent University, WiCa, G. Crommenlaan 8 box 201, 9050, Ghent, Belgium

    Toon De Pessemier, Luc Martens & Wout Joseph

  2. Department of Communication Sciences, iMinds - Ghent University, MICT, Korte Meer 7-9-11, 9000, Ghent, Belgium

    Isabelle Stevens & Lieven De Marez

Authors
  1. Toon De Pessemier
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isabelle Stevens
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lieven De Marez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luc Martens
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wout Joseph
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Toon De Pessemier.

Rights and permissions

Reprints and permissions

About this article

Cite this article

De Pessemier, T., Stevens, I., De Marez, L. et al. Analysis of the quality of experience of a commercial voice-over-IP service. Multimed Tools Appl 74, 5873–5895 (2015). https://doi.org/10.1007/s11042-014-1895-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-1895-4

Keywords

Search

Navigation