Skip to main content
SpringerLink
Log in

UI Design Recommendations for Multimodal XR Interfaces Using a Collaborative System

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14027))

Included in the following conference series:

  • 1141 Accesses

Abstract

Over the past years, various design guidelines such as Nielsen’s heuristics have been proposed in order to guide researchers and developers in creating usable and consistent user interfaces (UIs) [12]. However, within the field of Extended Reality (XR), existing relevant design guidelines are still limited due to the newness of spatial technologies such as head-mounted displays (HMDs) now entering the consumer market. As applications continue to emerge that span multiple modalities and realities, guidance for researchers and developers in initial design stages is needed. This paper presents results of 1-on-1 interview sessions with UX experts in industry, using an existing collaborative multimodal system as a use case. After a brief introduction to the use case, researchers were asked questions regarding application-specific considerations, as well as broader scalability implications. Thematic analysis was conducted using interview audio transcripts to determine the most prominent themes. Results include a set of general recommendations that can be used to guide researchers in early design stages of creating multimodal user interfaces for XR applications, such as evaluation of form-factor capabilities and determination of the context of use.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. HTC Vive Pro 2 Virtual Reality Headset. vive.com (2022). https://myshop-us.vive.com/

  2. Microsoft HoloLens 2. microsoft.com (2022). https://www.microsoft.com/en-us/d/hololens-2/

  3. Amburn, C., Vey, N., Boyce, M., Mize, J.: The augmented reality sandtable (ARES)(No. ARL-SR-0340). Army Res. Lab. (2015)

    Google Scholar 

  4. Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006)

    Article  Google Scholar 

  5. Clarke, V., Braun, V., Hayfield, N.: Thematic analysis. Qual. Psychol.: Pract. Guide Res. Methods 3, 222–248 (2015)

    Google Scholar 

  6. Dovetail. https://dovetailapp.com/

  7. Endsley, T.C., Sprehn, K.A., Brill, R.M., Ryan, K.J., Vincent, E.C., Martin, J.M.: Augmented reality design heuristics: designing for dynamic interactions. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 61, pp. 2100–2104. Sage Publications Sage CA, Los Angeles, CA (2017)

    Google Scholar 

  8. Krauß, V., Jasche, F., Saßmannshausen, S.M., Ludwig, T., Boden, A.: Research and practice recommendations for mixed reality design-different perspectives from the community. In: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, pp. 1–13 (2021)

    Google Scholar 

  9. Krauß, V., Nebeling, M., Jasche, F., Boden, A.: Elements of XR prototyping: characterizing the role and use of prototypes in augmented and virtual reality design. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–18 (2022)

    Google Scholar 

  10. Memmesheimer, V.M., Ebert, A.: Scalable extended reality: a future research agenda. Big Data Cogn. Comput. 6(1), 12 (2022)

    Article  Google Scholar 

  11. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  12. Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 152–158 (1994)

    Google Scholar 

  13. Parveau, M., Adda, M.: Toward a user-centric classification scheme for extended reality paradigms. J. Ambient. Intell. Humaniz. Comput. 11(6), 2237–2249 (2020)

    Article  Google Scholar 

  14. Vardomatski, S.: Council post: augmented and virtual reality after COVID-19, November 2022. https://www.forbes.com/sites/forbestechcouncil/2021/09/14/augmented-and-virtual-reality-after-covid-19/?sh=57711d092d97

  15. Vi, S., da Silva, T.S., Maurer, F.: User experience guidelines for designing HMD extended reality applications. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 319–341. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_18

    Chapter  Google Scholar 

  16. Xing, Y., Liang, Z., Shell, J., Fahy, C., Guan, K., Liu, B.: Historical data trend analysis in extended reality education field. In: 2021 IEEE 7th International Conference on Virtual Reality (ICVR), pp. 434–440. IEEE (2021)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Florida, Tampa, FL, 33620, USA

    Sarah Garcia & Marvin Andujar

Authors
  1. Sarah Garcia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marvin Andujar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sarah Garcia .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Garcia, S., Andujar, M. (2023). UI Design Recommendations for Multimodal XR Interfaces Using a Collaborative System. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. HCII 2023. Lecture Notes in Computer Science, vol 14027. Springer, Cham. https://doi.org/10.1007/978-3-031-35634-6_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35634-6_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35633-9

  • Online ISBN: 978-3-031-35634-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation