Extended reality interactive wall: User experience design research-creation | Intellect Skip to content
1981
Volume 10, Issue 2
  • ISSN: 2397-9704
  • E-ISSN: 2397-9712

Abstract

This article presents the development of an extended reality (XR) interactive wall design that employs augmented reality (AR) and virtual reality (AR) to display digital content in educational and exhibition settings. A wall design printed with a number of conventional graphical elements was enhanced with AR and VR, including AR-based video, a 360 virtual environment and 3D-scanned materials. The early design of the XR interactive wall was tested several times in a university setting during academic events designed to demonstrate science, technology, engineering and mathematics (STEM)-based content. This provided AR and VR experiences to participating visitors in an exhibition setting, where multimedia mobile devices were provided to aid these experiences. Inclusive design principles were employed, and elements integrated that allowed users (standing adults, children, wheelchair users) to view and interact with AR and VR content conveniently. After the initial introduction of the interactive wall design, the prototype was redesigned to fit both handheld and head-mount-device (HMD)-based mobile configurations. In this article we describe the prototype, a user experience study based on laboratory testing and directions for future work.

Loading

Article metrics loading...

/content/journals/10.1386/vcr_00030_1
2020-12-01
2024-04-23
Loading full text...

Full text loading...

/deliver/fulltext/vcr/10/2/vcr.10.2.163.html?itemId=/content/journals/10.1386/vcr_00030_1&mimeType=html&fmt=ahah

References

  1. Amin, M.. ( 2019), The Benefit of Designing for Everyone, Windsor:: PwC Australia;, https://centreforinclusivedesign.org.au/index.php/the-benefits-of-designing-for-everyone-report/. Accessed 16 December 2020.
    [Google Scholar]
  2. Billinghurst, M.,, Bai, H.,, Lee, G., and Lindeman, R.. ( 2014;), ‘ Developing handheld augmented reality interfaces. ’, in M. Grimshaw. (ed.), Oxford Handbook of Virtuality, Oxford:: Oxford University Press;, pp. 61535.
    [Google Scholar]
  3. Blum, J.,, Rockstroh, C., and Göritz, A. S.. ( 2019;), ‘ Heart rate variability biofeedback based on slow-paced breathing with immersive virtual reality nature scenery. ’, Frontier in Psychology, 10, p. 2172.
    [Google Scholar]
  4. Boland, M.. ( 2019;), ‘ XR talks: Will pass-through video outshine see-through optics?. ’, AR Insider, 26 August, https://arinsider.co/2019/04/26/xr- talks-will-video-pass-through-leapfrog-optical-waveguides/. Accessed 1 February 2020.
    [Google Scholar]
  5. Brooke, J.. ( 1996;), ‘ SUS – A quick and dirty usability scale. ’, Usability Evaluation in Industry, 189:194, pp. 47.
    [Google Scholar]
  6. Connell, B. R.,, Jones, M.,, Mace, R.,, Mueller, J.,, Mullick, A.,, Ostroff, E.,, Sanford, J.,, Steinfeld, E.,, Story, M., and Vanderheiden, G.. ( 1997;), ‘ Universal Design Principles. ’, The Center for Universal Design, 1 April, https://projects.ncsu.edu/ncsu/design/cud/about_ud/udprinciplestext.htm. Accessed 29 January 2020.
    [Google Scholar]
  7. Dey, A.,, Billinghurst, M.,, Lindeman, R. W., and Swan II, J. E.. ( 2018;), ‘ A systematic review of 10 years of augmented reality usability studies: 2005 to 2014. ’, Frontiers in Robotics and AI, 5, p. 37, https://doi.org/10.3389/frobt.2018.00037. Accessed 16 December 2020.
    [Google Scholar]
  8. Domingo, J. R., and Bradley, E. G.. ( 2018;), ‘ Education student perceptions of virtual reality as a learning tool. ’, Journal of Educational Technology Systems, 46:3, pp. 32942.
    [Google Scholar]
  9. Google ( 2019;), ‘ Google Cardboard product safety information. ’, https://arvr.google.com/cardboard/product-safety. Accessed 1 September 2019.
  10. Höllerer, T., and Feiner, S.. ( 2004), Mobile Augmented Reality: Telegeoinformatics: Location-Based Computing and Services, London:: Taylor and Francis Books;.
    [Google Scholar]
  11. Horst, R., and Dorner, R.. ( 2018), Opportunities for Virtual and Mixed Reality Knowledge Demonstration, n.p.:: ISMAR Adjunt;, IEEE .
    [Google Scholar]
  12. Interaction Design Foundation ( 2020), The Basics of User Experience (UX) Design by the Interaction Design Foundation, n.p.:: Interaction Design Foundation;.
    [Google Scholar]
  13. LYNX ( 2020;), ‘ The first AR + VR standalone headset. ’, LYNX, https://lynx-r.com/. Accessed 5 March 2020.
    [Google Scholar]
  14. Marsh, T., and Costello, B. M.. ( 2012;), ‘ Experience in serious games: Between positive and serious experience. ’, in M. Ma,, M. F. Oliveira,, J. B. Hauge,, H. Duin, and K. D. Thoben. (eds), Proceedings of the Third International Conference on Serious Games Development and Applications, Berlin and Heidelberg:: Springer;, pp. 25567.
    [Google Scholar]
  15. Masai, K.,, Kunze, K.,, Sugimoto, M., and Billinghurst, M.. ( 2016;), ‘ Empathy glasses. ’, in Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, San Jose, CA, May, New York:: Association for Computing Machinery;.
    [Google Scholar]
  16. Microsoft ( 2020;), ‘ Hololens 2 Get to know the new features and technical specs. ’, https://www.microsoft.com/en-us/hololens/hardware. Accessed 5 March 2020.
  17. NSW Government ( 2019;), Everyone Can Play a Guideline to Create Inclusive Playspaces. , Parramatta:: NSW Government;, https://www.planning.nsw.gov.au/-/media/Files/DPE/Guidelines/everyone-can-play-guideline-2019-02-20.pdf. Accessed 1 January 2020.
    [Google Scholar]
  18. Passa, C.. ( 2014;), ‘ The Widget Art Gallery – A Gallery 2.0.. ’, NODEM 2014, Poland, 1–3 December.
    [Google Scholar]
  19. PDC2020 ( n.d.;), Participatory Design Conference. , https://www.pdc2020.org/. Accessed 24 August 2020.
  20. Rose, V.,, Stewart, I.,, Jenkins, K. G.,, Ang, C. S., and Matsangidou, M.. ( 2018;), ‘ A scoping review exploring the feasibility of virtual reality technology use with individuals living with dementia. ’, in ICAT-EGVE 2018, The Eurographics, Limassol, Cyprus, 7–9 November.
    [Google Scholar]
  21. SCANN3D ( 2015;), ‘ Shadow Play goes 3D. ’, Sketchfab, https://sketchfab.com/models/030ca7cc3b9345b79181ae0ea244b71f#. Accessed 1 September 2018.
    [Google Scholar]
  22. Schuler, D., and Namioka, A.. ( 1993), Participatory Design, Hillsdale, NJ:: L. Erlbaum Associates;.
    [Google Scholar]
  23. See, Z. S.,, Billinghurst, M.,, Rengganaten, V., and Soo, S.. ( 2016;), ‘ Medical learning murmurs simulation with mobile audible augmented reality. ’, SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, Macao, 5–8 December.
    [Google Scholar]
  24. See, Z. S.,, Sunar, M. S. Billinghurst, M.,, Dey, A.,, Santano, D.,, Esmaeili, H., and Thwaites, H.. ( 2017;), ‘ An augmented reality and virtual reality pillar for exhibitions: A subjective exploration. ’, International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE2017), Australia, 22–24 November.
    [Google Scholar]
  25. Sural, I.. ( 2018;), ‘ Augmented reality experience: Initial perceptions of higher education. ’, International Journal of Instruction, 11:4, pp. 56576.
    [Google Scholar]
  26. Teo, T.,, Lawrence, L. M.,, Lee, G. A.,, Billinghurst, M. N., and Adcock, M.. ( 2019;), ‘ Mixed reality remote collaboration combining 360 video and 3D reconstruction. ’, CHI ‘19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow , 4–9 May.
    [Google Scholar]
  27. Thwaites, H.,, Santano, D.,, Esmaeili, H., and See, Z. S.. ( 2019;), ‘ A Malaysian cultural heritage digital compendium. ’, Digital Applications in Archaeology and Cultural Heritage, 15, p. e00116, https://www.sciencedirect.com/science/article/abs/pii/S2212054818300493. Accessed 16 December 2020.
    [Google Scholar]
  28. Valtchanov, D.,, Barton, K. R., and Ellard, C.. ( 2010;), ‘ Restorative effects of virtual nature settings. ’, Cyberpsychology, Behavior, and Social Networking, 13:5, https://pubmed.ncbi.nlm.nih.gov/20950174/. Accessed 16 December 2020.
    [Google Scholar]
  29. Varjo ( 2020;), ‘ Develop a new reality. ’, https://varjo.com/products/xr-1. Accessed 5 March 2020.
  30. Vuforia ( 2019;), ‘ Vuforia Engine 9.3. ’, https://developer.vuforia.com/downloads/sdk. Accessed 1 September 2019.
  31. W3 ( 2016;), ‘ Introduction to understanding WCAG 2.0. ’, https://www.w3.org/TR/UNDERSTANDING-WCAG20/intro.html#introduction-fourprincs-head. Accessed 1 February 2020.
  32. Yuichi, O., and Tamura, H.. ( 2014), Mixed Reality: Merging Real and Virtual Worlds, Berlin:: Springer Publishing Company;.
    [Google Scholar]
  33. See, Zi Siang,, Matthews, Benjamin,, Goodman, Lizbeth,, Jones, Donovan,, Hight, Craig,, Egglestone, Paul,, Amin, Manisha, and Ooi, Wooi Har. ( 2020;), ‘ Extended reality interactive wall: User experience design research-creation. ’, Virtual Creativity, 10:2, pp. 163174, doi: https://doi.org/10.1386/vcr_00030_1
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1386/vcr_00030_1
Loading
/content/journals/10.1386/vcr_00030_1
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error