Abstract
Immersive experiences with virtual reality systems are normally connected to user-scene interaction. The immersive system interprets movement commands and updates its output accordingly. When operating on PC and console games, interaction is typically triggered by hand-controllers’ buttons, including joysticks. When wearing a head-mounted display (HMD), user’s head-position can also prompt interaction, e.g. viewpoint changes. This is a major difference between operating on a HMD and on a desktop monitor. Changing observation viewpoint through head-rotation contributes to the user’s immersion in the observed world, as it comes naturally. However, this may lead to visual disturbances and loss of concentration in some applications, hindering tasks like scene overviewing, especially in complex dynamic environments. The latter would call for joystick use instead. This paper assesses the use of head-rotation and controller joystick to generate differences in observation viewpoint. Our application context is a three-dimensional dynamic scene where users must identify and discover threats represented by unmanned aerial vehicles (UAVs) entering a protected area. Two distinct levels of depth enhancements are provided using stereoscopic-3D visualization (S3D). Our focus is to see the effects of the two interaction modalities (head-rotation and joystick) and two S3D levels. We evaluate user performance in terms of mission success and action timing, and assess how they relate to learning and memorization. Eye movements are also analyzed to help understand user interaction patterns and focus of attention.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Situation Awareness Global Assessment Technique (SAGAT) – a freeze probe technique to test memory of the current task.
References
Endsley, M.R.: A systematic review and meta-analysis of direct objective measures of situation awareness: a comparison of SAGAT and SPAM. Hum. Factors. 63, 124–150 (2021). https://doi.org/10.1177/0018720819875376
Ali, M., Cardona-Rivera, R.E.: Comparing gamepad and naturally-mapped controller effects on perceived virtual reality experiences. In: ACM Symposium on Applied Perception 2020, pp. 1–10. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3385955.3407923.
Seibert, J., Shafer, D.: Control mapping in virtual reality: effects on spatial presence and controller naturalness. Virtual Real. 22, 1–10 (2018). https://doi.org/10.1007/s10055-017-0316-1
Ebnali, M., Lamb, R., Fathi, R., Hulme, K.: Virtual reality tour for first-time users of highly automated cars: comparing the effects of virtual environments with different levels of interaction fidelity. Appl. Ergon. 90, 103226 (2021). https://doi.org/10.1016/j.apergo.2020.103226
Ragan, E.D., Scerbo, S., Bacim, F., Bowman, D.A.: Amplified head rotation in virtual reality and the effects on 3D search, training transfer, and spatial orientation. IEEE Trans. Vis. Comput. Graph. 23, 1880–1895 (2017). https://doi.org/10.1109/TVCG.2016.2601607
Sargunam, S.P., Moghadam, K.R., Suhail, M., Ragan, E.D.: Guided head rotation and amplified head rotation: evaluating semi-natural travel and viewing techniques in virtual reality. In: 2017 IEEE Virtual Reality (VR), pp. 19–28 (2017). https://doi.org/10.1109/VR.2017.7892227
Navigation in virtual reality: Comparison of gaze-directed and pointing motion control. https://ieeexplore.ieee.org/abstract/document/7495413/. Accessed 15 Mar 2022
Sharples, S., Cobb, S., Moody, A., Wilson, J.R.: Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems. Displays. 29, 58–69 (2008). https://doi.org/10.1016/j.displa.2007.09.005
Bayramova, R., Valori, I., McKenna-Plumley, P.E., Callegher, C.Z., Farroni, T.: The role of vision and proprioception in self-motion encoding: an immersive virtual reality study. Atten. Percept. Psychophys. 83, 2865–2878 (2021). https://doi.org/10.3758/s13414-021-02344-8
Ragan, E.D., Kopper, R., Schuchardt, P., Bowman, D.A.: Studying the effects of stereo, head tracking, and field of regard on a small-scale spatial judgment task. IEEE Trans. Vis. Comput. Graph. 19, 886–896 (2013). https://doi.org/10.1109/TVCG.2012.163
Ragan, E., Bowman, D., Kopper, R., Stinson, C., Scerbo, S., McMahan, R.: Effects of field of view and visual complexity on virtual reality training effectiveness for a visual scanning task. IEEE Trans. Vis. Comput. Graph. 21, 1–1 (2015). https://doi.org/10.1109/TVCG.2015.2403312
Zocco, A., Zocco, M.D., Greco, A., Livatino, S., De Paolis, L.T.: Touchless interaction for command and control in military operations. In: De Paolis, L., Mongelli, A. (eds.) AVR 2015. LNCS, vol. 9254, pp. 432–445. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22888-4_32
Ratcliffe, J., Tokarchuk, L.: Sensorimotor learning in immersive virtual reality: a scoping literature review. In: 2021 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 276–286 (2021). https://doi.org/10.1109/AIVR52153.2021.00061
Penumudi, S.A., Kuppam, V.A., Kim, J.H., Hwang, J.: The effects of target location on musculoskeletal load, task performance, and subjective discomfort during virtual reality interactions. Appl. Ergon. 84, 103010 (2020). https://doi.org/10.1016/j.apergo.2019.103010
Carter, B.T., Luke, S.G.: Best practices in eye tracking research. Int. J. Psychophysiol. 155, 49–62 (2020). https://doi.org/10.1016/j.ijpsycho.2020.05.010
Zhang, T., et al.: Physiological measurements of situation awareness: a systematic review. Hum. Factors. 0018720820969071 (2020). https://doi.org/10.1177/0018720820969071
Lamb, M., Brundin, M., Perez Luque, E., Billing, E.: Eye-tracking beyond peripersonal space in virtual reality: validation and best practices. Front. Virtual Real. 3, 1–19 (2022)
Kulshreshth, A., LaViola, J.J.: Dynamic stereoscopic 3D parameter adjustment for enhanced depth discrimination. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 177–187. Association for Computing Machinery, New York, NY, USA (2016).
Computational Imaging Gaze-Contingent Ocular Parallax Rendering for VR | TOG 2020. https://www.computationalimaging.org/publications/gaze-contingent-ocular-parallax-rendering-for-virtual-reality/. Accessed 24 Apr 2022
Levac, D.E., Huber, M.E., Sternad, D.: Learning and transfer of complex motor skills in virtual reality: a perspective review. J. NeuroEng. Rehabil. 16, 121 (2019). https://doi.org/10.1186/s12984-019-0587-8
Zocco, A., Livatino, S., De Paolis, L.T.: Stereoscopic-3D vision to improve situational awareness in military operations. In: De Paolis, L., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 351–362. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-13969-2_26
Naceri, A., Moscatelli, A., Chellali, R.: Depth discrimination of constant angular size stimuli in action space: accommodation and convergence cues. Front. Hum. Neurosci. 9, 511 (2015)
Rahimi, K., Banigan, C., Ragan, E.D.: Scene transitions and teleportation in virtual reality and the implications for spatial awareness and sickness. IEEE Trans. Vis. Comput. Graph. 26, 2273–2287 (2020). https://doi.org/10.1109/TVCG.2018.2884468
LOKI | Elettronica Roma. https://www.elt-roma.com/product/loki. Accessed 11 May 2021
Livatino, S., Muscato, G., Sessa, S., Neri, V.: Depth-enhanced mobile robot teleguide based on laser images. Mechatronics. 20, 739–750 (2010). https://doi.org/10.1016/j.mechatronics.2010.01.011
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Livatino, S., Zocco, A., Iqbal, Y., Gainley, P., Morana, G., Farinella, G.M. (2022). Effects of Head Rotation and Depth Enhancement in Virtual Reality User-Scene Interaction. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2022. Lecture Notes in Computer Science, vol 13445. Springer, Cham. https://doi.org/10.1007/978-3-031-15546-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-15546-8_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15545-1
Online ISBN: 978-3-031-15546-8
eBook Packages: Computer ScienceComputer Science (R0)