Dongbiao He
ABSTRACT
The responsiveness of the network is critical when the application is immersive video streaming or 360 degree video streaming. The users look at the video stream on a display that can only show a fraction of the full video stream, and the time that the information spend in transit dramatically impacts the QoE of the end user. Further, transmitting a 360 degree video stream significantly increases the bandwidth usage and the impact on the already strained network. We propose a mechanism to use the responsiveness of the network to perform a Field of View (FoV) adaptation, so as to reduce the bandwidth consumption while at the same time enhancing the QoE of the user. In our simulation, such mechanism significantly improves the resolution seen by the end user, by selecting a higher bit rate. This translates to an improvement of up to 1.34 x better resolution when compared with the full spherical 360 degree video stream. Further, when rate adaption is used, it ensures the QoE of end users evolves according to the changes in the network conditions. This means that our proposed rate and FoV adaptation based upon the network responsiveness achieves both the apprently contradictory goals of increasing the end-user QoE and reducing the overall bandwidth consumption at the network layer.
- Shahryar Afzal, Jiasi Chen, and K. K. Ramakrishnan. 2017. Characterization of 360-degree Videos. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network (VR/AR Network '17). ACM. Google Scholar
Digital Library
- NGMN Alliance. 2015. NGMN 5G White Paper. https://www.ngmn.org/uploads/media/NGMN_5G_White_Paper_V1_0.pdf. (Feb. 2015).Google Scholar
- Stephen Cass and Charles Choi. 2015. Google Glass, HoloLens, and the Real Future of Augmented Reality. In IEEE Spectrum.Google Scholar
- Jacob Chakareski. 2017. VR/AR Immersive Communication: Caching, Edge Computing, and Transmission Trade-Offs. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. ACM, 36--41. Google ScholarDigital Library
- Jacob Chakareski, Ridvan Aksu, Xavier Corbillon, Gwendal Simon, and Viswanathan Swaminathan. 2018. Viewport-Driven Rate-Distortion Optimized 360° Video Streaming. arXiv preprint arXiv:1803.08177 (2018).Google Scholar
- Xavier Corbillon, Francesca De Simone, and Gwendal Simon. 2017. 360-degree video head movement dataset. In Proceedings of the 8th ACM on Multimedia Systems Conference. ACM, 199--204. Google ScholarDigital Library
- Xavier Corbillon, Alisa Devlic, Gwendal Simon, and Jacob Chakareski. 2017. Optimal Set of 360-Degree Videos for Viewport-Adaptive Streaming. in Proc. of ACM Multimedia (MM) (2017). Google ScholarDigital Library
- Xavier Corbillon, Gwendal Simon, Alisa Devlic, and Jacob Chakareski. 2017. Viewport-adaptive navigable 360-degree video delivery. In Communications (ICC), 2017 IEEE International Conference on. IEEE, 1--7.Google ScholarCross Ref
- Fanyi Duanmu, Eymen Kurdoglu, S Amir Hosseini, Yong Liu, and Yao Wang. 2017. Prioritized buffer control in two-tier 360 video streaming. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. ACM, 13--18. Google ScholarDigital Library
- F. Duanmu, E. Kurdoglu, Y. Liu, and Y. Wang. 2017. View direction and bandwidth adaptive 360 degree video streaming using a two-tier system. In 2017 IEEE International Symposium on Circuits and Systems (ISCAS).Google Scholar
- Tarek El-Ganainy. 2017. Spatiotemporal Rate Adaptive Tiled Scheme for 360 Sports Events. CoRR abs/1705.04911 (2017). http://arxiv.org/abs/1705.04911Google Scholar
- Mohammad Hosseini and Viswanathan Swaminathan. 2016. Adaptive 360 VR Video Streaming based on MPEG-DASH SRD. In IEEE International Symposium on Multimedia (ISM'16).Google ScholarCross Ref
- Xing Liu, Qingyang Xiao, Vijay Gopalakrishnan, Bo Han, Feng Qian, and Matteo Varvello. 2017. 360 Innovations for Panoramic Video Streaming. In Proceedings of the 16th ACM Workshop on Hot Topics in Networks. ACM, 50--56. Google ScholarDigital Library
- Simone Mangiante, Guenter Klas, Amit Navon, Zhuang GuanHua, Ju Ran, and Marco Dias Silva. 2017. Vr is on the edge: How to deliver 360 videos in mobile networks. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. ACM, 30--35. Google ScholarDigital Library
- Kazuhisa Matsuzono, Hitoshi Asaeda, and Thierry Turletti. 2017. Low latency low loss streaming using in-network coding and caching. In INFOCOM 2017-IEEE Conference on Computer Communications, IEEE. IEEE, 1--9.Google ScholarCross Ref
- Djuro Mirkovic, Grenville Armitage, and Philip Branch. 2018. A survey of Round Trip Time Prediction Systems. IEEE Communications Surveys & Tutorials (2018).Google Scholar
- Feng Qian, Bo Han, Lusheng Ji, and Vijay Gopalakrishnan. 2016. Optimizing 360 Video Delivery Over Cellular Networks. In ACM MobiCom All Things Cellular Workshop. Google ScholarDigital Library
- Cedric Westphal. 2017. Challenges in Networking to Support Augmented Reality and Virtual Reality. In IEEE ICNC.Google Scholar
- Liyang Zhang, Syed Obaid Amin, and Cedric Westphal. 2017. VR video conferencing over named data networks. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network. ACM, 7--12. Google ScholarDigital Library
Index Terms
- Joint Rate and FoV adaptation in immersive video streaming
Recommendations
Battery-aware rate adaptation for extending video streaming playback time
Multimedia streaming applications are computation and network intensive that put a high demand on battery usage of mobile devices. Battery usage forms an important metric in user satisfaction, as increased battery consumption results in faster battery ...
Joint Quality and Rate Adaptation Scheme for Wireless Video Streaming
AINA '08: Proceedings of the 22nd International Conference on Advanced Information Networking and ApplicationsTo provide efficient wireless video streaming service, the rate adaptation scheme should be applied at the low layer and the quality adaptation scheme should be considered at the high layer. To meet this requirement of wireless video streaming, we ...
Combining the rate adaptation and quality adaptation schemes for wireless video streaming
Video streaming service over wireless networks is a challenging task because of the changes in the wireless channel conditions that can occur due to interference, fading, and station mobility. Moreover, the IEEE 802.11 WLAN standard does not contain any ...
Comments