skip to main content
10.1145/3339825.3394925acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article
Artifacts Available

An open software for bitstream-based quality prediction in adaptive video streaming

Published:27 May 2020Publication History

ABSTRACT

HTTP Adaptive Streaming (HAS) has become a popular solution for multimedia delivery nowadays. However, because of throughput fluctuations, video quality may be dramatically varying. Also, stalling events may occur during a streaming session, causing negative impacts on user experience. Therefore, a main challenge in HAS is how to evaluate the overall quality of a session taking into account the impacts of quality variations and stalling events. In this paper, we present an open software, called BiQPS, using a Long-Short Term Memory (LSTM) network to predict the overall quality of HAS sessions. The prediction is based on bitstream-level parameters, so it can be directly applied in practice. Through experiment results, it is found that BiQPS outperforms four existing models. Our software has been made available to the public at https://github.com/TranHuyen1191/BiQPS.

References

  1. C. G. Bampis, Z. Li, I. Katsavounidis, and A. C. Bovik. 2018. Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience. IEEE Transactions on Image Processing 27, 7 (Jul. 2018), 3316--3331. Google ScholarGoogle ScholarCross RefCross Ref
  2. C. G. Bampis, Z. Li, I. Katsavounidis, TY Huang, C. Ekanadham, and A. C. Bovik. 2018. Towards Perceptually Optimized End-to-end Adaptive Video Streaming. submitted to IEEE Transactions on Image Processing (2018). arXiv:eess.IV/1808.03898 https://arxiv.org/abs/1808.03898Google ScholarGoogle Scholar
  3. S. Chikkerur, V. Sundaram, M. Reisslein, and L. J. Karam. 2011. Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison. IEEE Transactions on Broadcasting 57, 2 (June 2011), 165--182. Google ScholarGoogle ScholarCross RefCross Ref
  4. Conviva. 2019. Conviva state of streaming. (2019). https://www.conviva.com/state-of-streaming/, accessed 2020-01-15.Google ScholarGoogle Scholar
  5. Z. Duanmu, A. Rehman, and Z. Wang. 2018. A Quality-of-Experience Database for Adaptive Video Streaming. IEEE Transactions on Broadcasting 64, 2 (Jun. 2018), 474--487. Google ScholarGoogle ScholarCross RefCross Ref
  6. N. Eswara, S. Ashique, A. Panchbhai, S. Chakraborty, H. P. Sethuram, K. Kuchi, A. Kumar, and S. S. Channappayya. 2019. Streaming Video QoE Modeling and Prediction: A Long Short-Term Memory Approach. IEEE Transactions on Circuits and Systems for Video Technology (2019), 1--1.Google ScholarGoogle Scholar
  7. Zhili Guo, Yao Wang, and Xiaoqing Zhu. 2015. Assessing the visual effect of non-periodic temporal variation of quantization stepsize in compressed video. In 2015 IEEE International Conference on Image Processing (ICIP). Quebec City, Canada, 3121--3125.Google ScholarGoogle ScholarCross RefCross Ref
  8. Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. (2014). arXiv:1412.6980 http://arxiv.org/abs/1412.6980Google ScholarGoogle Scholar
  9. Yao Liu, Sujit Dey, Fatih Ulupinar, Michael Luby, and Yinian Mao. 2015. Deriving and validating user experience model for DASH video streaming. IEEE Transactions on Broadcasting 61, 4 (2015), 651--665.Google ScholarGoogle ScholarCross RefCross Ref
  10. Alexander Raake, Marie-Neige Garcia, Werner Robitza, Peter List, Steve Göring, and Bernhard Feiten. 2017. A bitstream-based, scalable video-quality model for HTTP adaptive streaming: ITU-T P.1203.1. In Ninth International Conference on Quality of Multimedia Experience (QoMEX). Erfurt, Germany, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  11. Recommendation ITU-T P.1203.3. 2017. Parametric bitstream-based quality assessment of progressive download and adaptive audiovisual streaming services over reliable transport-Quality integration module. International Telecommunication Union (2017).Google ScholarGoogle Scholar
  12. Recommendation ITU-T P.1401. 2012. Methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models. International Telecommunication Union (2012).Google ScholarGoogle Scholar
  13. Werner Robitza, Steve Göring, Alexander Raake, David Lindegren, Gunnar Heikkilä, Jörgen Gustafsson, Peter List, Bernhard Feiten, Ulf Wüstenhagen, Marie-Neige Garcia, Kazuhisa Yamagishi, and Simon Broom. 2018. HTTP Adaptive Streaming QoE Estimation with ITU-T Rec. P.1203 - Open Databases and Software. In Proceedings of the 9th ACM Multimedia Systems Conference. Amsterdam, Netherlands, 466--471. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Demóstenes Zegarra Rodríguez, Renata Lopes Rosa, Eduardo Costa Alfaia, Julia Issy Abrahão, and Graça Bressan. 2016. Video quality metric for streaming service using DASH standard. IEEE Transactions on Broadcasting 62, 3 (2016), 628--639.Google ScholarGoogle ScholarCross RefCross Ref
  15. Sandvine. 2019. The Global Internet Phenomena Report. (Sept. 2019). https://www.sandvine.com/phenomena, accessed 2020-01-11.Google ScholarGoogle Scholar
  16. Michael Seufert, Sebastian Egger, Martin Slanina, Thomas Zinner, Tobias Hoßfeld, and Phuoc Tran-Gia. 2015. A survey on quality of experience of HTTP adaptive streaming. IEEE Communications Surveys & Tutorials 17, 1 (2015), 469--492.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kamal Deep Singh, Yassine Hadjadj-Aoul, and Gerardo Rubino. 2012. Quality of experience estimation for adaptive HTTP/TCP video streaming using H. 264/AVC. In 2012 IEEE Consumer Communications and Networking Conference (CCNC). Las Vegas, USA, 127--131.Google ScholarGoogle ScholarCross RefCross Ref
  18. Samira Tavakoli, Sebastian Egger, Michael Seufert, Raimund Schatz, Kjell Brunnström, and Narciso García. 2016. Perceptual quality of HTTP adaptive streaming strategies: Cross-experimental analysis of multi-laboratory and crowd-sourced subjective studies. IEEE Journal on Selected Areas in Communications 34, 8 (2016), 2141--2153.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. H. T. T. Tran, D. V. Nguyen, D. D. Nguyen, N. P. Ngoc, and T. C. Thang. 2019. An LSTM-based Approach for Overall Quality. In IEEE Conference on Computer Communications Conference (INFOCOM 2019). Paris.Google ScholarGoogle Scholar
  20. H. T. T. Tran, D. V. Nguyen, D. D. Nguyen, N. P. Ngoc, and T. C. Thang. 2020. Cumulative Quality Modeling for HTTP Adaptive Streaming. Available on: https://arxiv.org/abs/1909.02772.Google ScholarGoogle Scholar
  21. J. De Vriendt, D. De Vleeschauwer, and D. Robinson. 2013. Model for estimating QoE of video delivered using HTTP adaptive streaming. In 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013). Ghent, Belgium, 1288--1293.Google ScholarGoogle Scholar
  22. Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A control-theoretic approach for dynamic adaptive video streaming over HTTP. ACM SIGCOMM Computer Communications Review 45, 4 (2015), 325--338.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Z. Duanmu, K. Ma, and Z. Wang. 2017. Quality-of-Experience of Adaptive Video Streaming: Exploring the Space of Adaptations. In Proceedings of the 25th ACM international conference on Multimedia. Mountain View, USA, 1752--1760.Google ScholarGoogle Scholar

Index Terms

  1. An open software for bitstream-based quality prediction in adaptive video streaming

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MMSys '20: Proceedings of the 11th ACM Multimedia Systems Conference
      May 2020
      403 pages
      ISBN:9781450368452
      DOI:10.1145/3339825

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 May 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      MMSys '20 Paper Acceptance Rate18of55submissions,33%Overall Acceptance Rate176of530submissions,33%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader