Abstract
Gesture-based interactions have been widely applied in Human-Computer Interaction areas. As Extended Reality technology (XR) has grown rapidly, gesture has also grown in importance as a way of interaction in XR. Although there have been many efforts on gesture taxonomy in HCI, there is a lack of works that classify gestures focusing on their applications and roles in XR domains. We have been working on a taxonomy that incorporates important previous works on gesture taxonomies, modifies, and injects new dimensions for the taxonomy to better reflect the wide variety of contexts and scenarios in XR. This paper presents a gesture system architecture for Extended Reality based on our ongoing work on a multi-dimensional taxonomy of gesture in XR applications. This gesture system architecture can be used to build general-purpose gesture systems that will be easy for both designers and users to choose the right gesture for the situation at hand.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aigner, R., et al.: Understanding mid-air hand gestures: a study of human preferences in usage of gesture types for HCI. Microsoft Res. TechReport MSR-TR-2012-111 2, 30 (2012)
Carfì, A., Mastrogiovanni, F.: Gesture-based human-machine interaction: taxonomy, problem definition, and analysis. IEEE Trans. Cybern. (2021)
Ens, B., Quigley, A., Yeo, H.S., Irani, P., Piumsomboon, T., Billinghurst, M.: Counterpoint: exploring mixed-scale gesture interaction for AR applications. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–6. ACM, Montreal QC Canada, April 2018. https://doi.org/10.1145/3170427.3188513, https://dl.acm.org/doi/10.1145/3170427.3188513
Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)
Ruiz, J., Li, Y., Lank, E.: User-defined motion gestures for mobile interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 197–206 (2011)
Vafaei, F.: Taxonomy of Gestures in Human Computer Interaction. North Dakota State University, Fargo (2013)
Vuletic, T., Duffy, A., Hay, L., McTeague, C., Campbell, G., Grealy, M.: Systematic literature review of hand gestures used in human computer interaction interfaces. Int. J. Hum Comput Stud. 129, 74–94 (2019)
Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1083–1092 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yao, P., Yang, T., Zyda, M. (2023). Toward a Gesture System Architecture in Extended Reality Based on a Multi-dimensional Taxonomy of Gestures. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2023 Posters. HCII 2023. Communications in Computer and Information Science, vol 1836. Springer, Cham. https://doi.org/10.1007/978-3-031-36004-6_47
Download citation
DOI: https://doi.org/10.1007/978-3-031-36004-6_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36003-9
Online ISBN: 978-3-031-36004-6
eBook Packages: Computer ScienceComputer Science (R0)