skip to main content
10.1145/3629527.3651421acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
research-article
Open Access

Towards a Workload Trace Archive for Metaverse Systems

Published:07 May 2024Publication History

ABSTRACT

Recent years have seen a resurgence of societal interest in Metaverses and virtual reality (VR), with large companies such as Meta and Apple investing multi-billion dollars into its future. With the recent developments in VR hardware and software, understanding how to operate these systems efficiently and with good performance becomes increasingly important. However, studying Metaverse and VR systems is challenging because publicly available data detailing the performance of these systems is rare. Moreover, collecting this data is labor-intensive because VR devices are end-user devices that are driven by human input. In this work, we address this challenge and work towards a workload trace archive for Metaverse systems. To this end, we design, implement, and validate librnr, a system to record and replay human input on VR devices, automating large parts of the process of collecting VR traces. We use librnr to collect 106 traces with a combined runtime of 7 hours from state-of-the-art VR hardware under a variety of representative scenarios. Through analysis of our initial results, we find that power use of VR devices can increase by up to 29% depending on the location of the VR device relative to the user-defined play area, and show that noticeable performance degradation can occur when network bandwidth drops below 100Mbps. Encouraging community adoption of both librnr and the emerging trace archive, we publish both according to FAIR data principles at https://github.com/atlarge-research/librnr.

References

  1. 2024. Virtual Reality in Gaming Market Size | Global Analysis [2028]. https://www.fortunebusinessinsights.com/industry-reports/virtual-realitygaming- market-100271 Accessed 2024-02-06.Google ScholarGoogle Scholar
  2. Pooya Adami, Patrick B. Rodrigues, Peter J.Woods, Burcin Becerik-Gerber, Lucio Soibelman, Yasemin Copur-Gencturk, and Gale M. Lucas. 2021. Effectiveness of VR-based training on improving construction workers' knowledge, skills, and safety behavior in robotic teleoperation. Adv. Eng. Informatics 50 (2021), 101431.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ahmad Alhilal, Kirill A. Shatilov, Gareth Tyson, Tristan Braud, and Pan Hui. 2023. Network Traffic in the Metaverse: The Case of Social VR. In 43rd IEEE International Conference on Distributed Computing Systems, ICDCS 2023 - Workshops, Hong Kong, July 18--21, 2023. 109--114.Google ScholarGoogle Scholar
  4. Apple. 2023. Introducing Apple Vision Pro: Apple's first spatial computer. https://www.apple.com/newsroom/2023/06/introducing-apple-visionpro- apples-first-spatial-computer Accessed 2024-01-04.Google ScholarGoogle Scholar
  5. Martin Armstrong. 2023. Chart: Meta Leads the Way in VR Headsets. https: //www.statista.com/chart/29398/vr-headset-kpis/ Accessed 2024-03-06.Google ScholarGoogle Scholar
  6. Patrick Carnahan, John Moore, Daniel Bainbridge, Gavin Wheeler, Shujie Deng, Kuberan Pushparajah, Elvis C. S. Chen, John M. Simpson, and Terry M. Peters. 2020. Applications of VR medical image visualization to chordal length measurements for cardiac procedures. In Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, Houston, TX, USA, February 15--20, 2020, Vol. 11315. 1131528.Google ScholarGoogle Scholar
  7. Eli Cortez, Anand Bonde, Alexandre Muzio, Mark Russinovich, Marcus Fontoura, and Ricardo Bianchini. 2017. Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms. In Proceedings of the 26th Symposium on Operating Systems Principles, Shanghai, China, October 28--31, 2017. 153--167.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Vittorio Cozzolino, Leonardo Tonetto, Nitinder Mohan, Aaron Yi Ding, and Jörg Ott. 2023. Nimbus: Towards Latency-Energy Efficient Task Offloading for AR Services. IEEE Trans. Cloud Comput. 11, 2 (2023), 1530--1545.Google ScholarGoogle ScholarCross RefCross Ref
  9. Martin Danhier, Karim El Khoury, and Benoît Macq. 2023. An Open-Source Fine- Grained Benchmarking Platform for Wireless Virtual Reality. In Virtual Reality and Mixed Reality - 20th EuroXR International Conference, EuroXR 2023, Rotterdam, The Netherlands, November 29 - December 1, 2023, Proceedings, Vol. 14410. 115--121.Google ScholarGoogle Scholar
  10. Jesse Donkervliet, Matthijs Jansen, Animesh Trivedi, and Alexandru Iosup. 2023. Can My WiFi Handle the Metaverse? A Performance Evaluation Of Meta's Flagship Virtual Reality Hardware. In Proceedings of the International Conference on Performance Engineering, Coimbra, Portugal, April, 2023.Google ScholarGoogle Scholar
  11. Paul M.G. Emmelkamp and Katharina Meyerbröker. 2021. Virtual Reality Therapy in Mental Health. Annual Review of Clinical Psychology 17, 1 (2021), 495--519.Google ScholarGoogle ScholarCross RefCross Ref
  12. Yong Guo and Alexandru Iosup. 2012. The Game Trace Archive. In 11th Annual Workshop on Network and Systems Support for Games, NetGames 2012, Venice, Italy, November 22--23, 2012. 1--6.Google ScholarGoogle Scholar
  13. Business Insider. 2022. Charts: Meta's Metaverse Spending Losses, Reality Labs, VR, Mark Zuckerberg. https://www.businessinsider.com/charts-meta-metaversespending- losses-reality-labs-vr-mark-zuckerberg-2022--10 Accessed 2024-01-04.Google ScholarGoogle Scholar
  14. Yue Leng, Jian Huang, Chi-Chun Chen, Qiuyue Sun, and Yuhao Zhu. 2020. Energy- Efficient Video Processing for Virtual Reality. IEEE Micro 40, 3 (2020), 30--36.Google ScholarGoogle ScholarCross RefCross Ref
  15. Yen-Chun Li, Chia-Hsin Hsu, Yu-Chun Lin, and Cheng-Hsin Hsu. 2020. Performance Measurements on a Cloud VR Gaming Platform. In QoEVMA'20: Proceedings of the 1st Workshop on Quality of Experience (QoE) in Visual Multimedia Applications, Seattle, WA, USA, October 16, 2020. 37--45.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Meta. 2023. Set up your boundary for Meta Quest. https://www.meta.com/engb/ help/quest/articles/in-vr-experiences/oculus-features/boundary/ Accessed 2024-03--13.Google ScholarGoogle Scholar
  17. Meta. 2024. Meta Quest Pro: Premium mixed reality. https://www.meta.com/ quest/quest-pro/ Accessed 2024-03--13.Google ScholarGoogle Scholar
  18. Evan Mills, Norman Bourassa, Leo Rainer, Jimmy Mai, Arman Shehabi, and Nathaniel Mills. 2019. Toward Greener Gaming: Estimating National Energy Use and Energy Efficiency Potential. Comput. Games J. 8, 3--4 (2019), 157--178.Google ScholarGoogle ScholarCross RefCross Ref
  19. Nathaniel Mills and Evan Mills. 2016. Taming the energy use of gaming computers. Energy Efficiency 9, 2 (2016), 321--338.Google ScholarGoogle ScholarCross RefCross Ref
  20. Markus Murtinger, Jakob Carl Uhl, Helmut Schrom-Feiertag, Quynh Nguyen, Birgit Harthum, and Manfred Tscheligi. 2022. Assist the VR Trainer - Real-Time Dashboard and After-Action Review for Police VR Training. In IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2022, Rome, Italy, October 26--28, 2022. 69--74.Google ScholarGoogle Scholar
  21. Baraka William Nyamtiga, Airlangga Adi Hermawan, Yakub Fahim Luckyarno, Tae-Wook Kim, Deok-Young Jung, Jin Sam Kwak, and Ji-Hoon Yun. 2022. Edge- Computing-Assisted Virtual Reality Computation Offloading: An Empirical Study. IEEE Access 10 (2022), 95892--95907.Google ScholarGoogle ScholarCross RefCross Ref
  22. Neal Stephenson. 1992. Snow Crash. Bantam Spectra Books.Google ScholarGoogle Scholar
  23. Laurens Versluis, Roland Mathá, Sacheendra Talluri, Tim Hegeman, Radu Prodan, Ewa Deelman, and Alexandru Iosup. 2020. The Workflow Trace Archive: Open- Access Data From Public and Private Computing Infrastructures. IEEE Trans. Parallel Distributed Syst. 31, 9 (2020), 2170--2184.Google ScholarGoogle ScholarCross RefCross Ref
  24. Stefan Vldut, escu and Georgiana Camelia Stnescu. 2023. Environmental Sustainability of Metaverse: Perspectives from Romanian Developers. Sustainability 15, 15 (2023).Google ScholarGoogle Scholar
  25. Jialin Wang, Rongkai Shi, Wenxuan Zheng, Weijie Xie, Dominic Kao, and Hai- Ning Liang. 2023. Effect of Frame Rate on User Experience, Performance, and Simulator Sickness in Virtual Reality. IEEE Trans. Vis. Comput. Graph. 29, 5 (2023), 2478--2488.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Chenhao Xie, Xie Li, Yang Hu, Huwan Peng, Michael B. Taylor, and Shuaiwen Leon Song. 2021. Q-VR: system-level design for future mobile collaborative virtual reality. In ASPLOS '21: 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Virtual Event, USA, April 19--23, 2021. 587--599.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jingbo Zhao, Robert S. Allison, Margarita Vinnikov, and Sion Jennings. 2017. Estimating the motion-to-photon latency in head mounted displays. In 2017 IEEE Virtual Reality, VR 2017, Los Angeles, CA, USA, March 18--22, 2017. 313--314.Google ScholarGoogle Scholar
  28. Sihao Zhao, Hatem Abou-zeid, Ramy Atawia, Yoga Suhas Kuruba Manjunath, Akram Bin Sediq, and Xiao-Ping Zhang. 2021. Virtual Reality Gaming on the Cloud: A Reality Check. In IEEE Global Communications Conference, GLOBECOM 2021, Madrid, Spain, December 7--11, 2021. 1--6.Google ScholarGoogle Scholar
  29. Ziehen Zhu, Xianglong Feng, Zhongze Tang, Nan Jiang, Tian Guo, Lisong Xu, and Sheng Wei. 2022. Power-efficient live virtual reality streaming using edge offloading. In Proceedings of the 32nd ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2022, Athlone, Ireland, 17 June 2022. 57--63.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Paul Zikas, Antonis Protopsaltis, Nick Lydatakis, Mike Kentros, Stratos Geronikolakis, Steve Kateros, Manos Kamarianakis, Giannis Evangelou, Achilleas Filippidis, Eleni Grigoriou, Dimitris Angelis, Michail Tamiolakis, Michael Dodis, George Kokiadis, John Petropoulos, Maria Pateraki, and George Papagiannakis. 2023. MAGES 4.0: Accelerating the World's Transition to VR Training and Democratizing the Authoring of the Medical Metaverse. IEEE Computer Graphics and Applications 43, 2 (2023), 43--56.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards a Workload Trace Archive for Metaverse Systems

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Article Metrics

        • Downloads (Last 12 months)17
        • Downloads (Last 6 weeks)17

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader