Paul Lubos
Oscar Ariza
Frank Steinicke
ABSTRACT
Designing spatial user interfaces for virtual reality (VR) applications that are intuitive, comfortable and easy to use while at the same time providing high task performance is a challenging task. This challenge is even harder to solve since perception and action in immersive virtual environments differ significantly from the real world, causing natural user interfaces to elicit a dissociation of perceptual and motor space as well as levels of discomfort and fatigue unknown in the real world. In this paper, we present and evaluate the novel method to leverage joint-centered kinespheres for interactive spatial applications. We introduce kinespheres within arm's reach that envelope the reachable space for each joint such as shoulder, elbow or wrist, thus defining 3D interactive volumes with the boundaries given by 2D manifolds. We present a Fitts' Law experiment in which we evaluated the spatial touch performance on the inside and on the boundary of the main joint-centered kinespheres. Moreover, we present a confirmatory experiment in which we compared joint-centered interaction with traditional spatial head-centered menus. Finally, we discuss the advantages and limitations of placing interactive graphical elements relative to joint positions and, in particular, on the boundaries of kinespheres.
Supplemental Material
- F. Argelaguet and C. Andujar. A survey of 3D object selection techniques for virtual environments. Computers & Graphics, 37(3):121--136, 2013. Google Scholar
Digital Library
- O. J. Ariza Nunez, P. Lubos, and F. Steinicke. Hapring: A wearable haptic device for 3D interaction. In S. Diefenbach, N. Henze, and M. Pielot, editors, Proc. of Mensch und Computer, pages 421--424. De Gruyter Oldenbourg, 2015.Google Scholar
- R. Balakrishnan and I. S. MacKenzie. Performance differences in the fingers, wrist, and forearm in computer input control. In Proc. of ACM CHI, CHI '97, pages 303--310. ACM, 1997. Google ScholarDigital Library
- G. Borg. Psychophysical bases of perceived exertion. Medicine and science in sports and exercise, 14(5):377, 1982.Google Scholar
- D. Bowman. Interaction Techniques for Common Tasks in Immersive Virtual Environments: Design, Evaluation, and Application. PhD thesis, Georgia Institute of Technology, 1999. Google ScholarDigital Library
- D. Bowman and L. Hodges. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. In ACM SIGGRAPH i3D, pages 35--38, 1997. Google ScholarDigital Library
- J. Brooke et al. Sus-a quick and dirty usability scale. Usability evaluation in industry, 189(194):4--7, 1996.Google Scholar
- G. Bruder, F. Steinicke, and W. Stuerzlinger. Effects of visual conflicts on 3D selection task performance in stereoscopic display environments. In Proc. of IEEE 3DUI, pages 115--118, 2013.Google ScholarCross Ref
- G. Bruder, F. Steinicke, and W. Stuerzlinger. Touching the Void Revisited: Analyses of Touch Behavior On and Above Tabletop Surfaces. Proc. of INTERACT, 8117:278--296, 2013.Google Scholar
- S. Card, J. Mackinlay, and G. Robertson. A morphological analysis of the design space of input devices. ACM Transactions on Information Systems (TOIS), 9(2):99--122, 1991. Google ScholarDigital Library
- L.-W. Chan, H.-S. Kao, M. Y. Chen, M.-S. Lee, J. Hsu, and Y.-P. Hung. Touching the void: Direct-touch interaction for intangible displays. In Proc. of ACM CHI, pages 2625--2634, 2010. Google ScholarDigital Library
- J. Djajadiningrat. Cubby: what you see is where you act. Interlacing the display and manipulation spaces. PhD thesis, Industrial Design Engineering, Delft University of Technology, 1998.Google Scholar
- A. Dvorkin, R. Kenyon, and E. Keshner. Reaching within a dynamic virtual environment. Journal of NeuroEngineering and Rehabilitation, 4(23), 2007.Google Scholar
- B. M. Ens, R. Finnegan, and P. P. Irani. The Personal Cockpit: A Spatial Interface for Effective Task Switching on Head-worn Displays. In Proc. of ACM CHI, CHI '14, pages 3171--3180. ACM, 2014. Google ScholarDigital Library
- P. Fitts. The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement. Journal of Experimental Psychology: General, 47(6):381--391, 1954.Google ScholarCross Ref
- D. Gerber and D. Bechmann. The Spin Menu: A Menu System for Virtual Environments. In Proc. of IEEE VR, VR '05, pages 271--272. IEEE Computer Society, 2005. Google ScholarDigital Library
- T. Grossman and R. Balakrishnan. The design and evaluation of selection techniques for 3d volumetric displays. In Proc. of ACM UIST, pages 3--12, 2006. Google ScholarDigital Library
- D. Guinness, A. Jude, G. Poor, and A. Dover. Models for rested touchless gestural interaction. In Proc. of ACM SUI, pages 34--43, 2015. Google ScholarDigital Library
- T. Ha and W. Woo. An empirical evaluation of virtual hand techniques for 3d object manipulation in a tangible augmented reality environment. In Proc. of IEEE 3DUI, pages 91--98, 2010. Google ScholarDigital Library
- S. G. Hart. NASA-task load index (NASA-TLX) 20 years later. In Proc. of Human Factors and Ergonomics Society Annual Meeting, pages 904--908, 2006.Google ScholarCross Ref
- International Organization for Standardization. ISO/DIS 9241--9 Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9: Requirements for non-keyboard input devices, 2000.Google Scholar
- A. Jude, G. Poor, and D. Guinness. Personal Space: User Defined Gesture Space for GUI Interaction. In Proc. of ACM CHI, pages 1615--1620, 2014. Google ScholarDigital Library
- R. Kennedy, N. Lane, K. Berbaum, and M. Lilienthal. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology, 3(3):203--220, 1993.Google ScholarCross Ref
- R. Kopper, D. A. Bowman, M. G. Silva, and R. P. McMahan. A human motor behavior model for distal pointing tasks. International Journal of Human-Computer Studies (IJHCS), 68(10):603--615, 2010. Google ScholarDigital Library
- D. Lemmerman and J. LaViola Jr. Effects of Interaction-Display Offset on User Performance in Surround screen virtual environments. In Proc. of IEEE VR, pages 303--304, 2007.Google ScholarCross Ref
- F. C. Y. Li, D. Dearman, and K. N. Truong. Virtual Shelves: Interactions with Orientation Aware Devices. In Proc. of ACM UIST, UIST '09, pages 125--128. ACM, 2009. Google ScholarDigital Library
- G. Liu, R. Chua, and J. T. Enns. Attention for perception and action: task interference for action planning, but not for online control. Experimental Brain Research, 185:709--717, 2008.Google ScholarCross Ref
- J. Loomis and J. Knapp. Visual Perception of Egocentric Distance in Real and Virtual Environments. In L. Hettinger and M. Haas, editors, Virtual and Adaptive Environments, pages 21--46. Erlbaum, 2003.Google Scholar
- P. Lubos, G. Bruder, and F. Steinicke. Analysis of Direct Selection in Head-Mounted Display Environments. In Proc. of IEEE 3DUI, pages 1--8, 2014.Google ScholarCross Ref
- P. Lubos, G. Bruder, and F. Steinicke. Influence of Comfort on 3D Selection Task Performance in Immersive Desktop Setups. Journal of Virtual Reality and Broadcasting (JVRB), 12(2), 2015.Google Scholar
- C. MacKenzie, R. Marteniuka, C. Dugasa, D. Liskea, and B. Eickmeiera. Three-dimensional movement trajectories in Fitts' task: Implications for control. The Quarterly Journal of Experimental Psychology A, 34(4):629--647, 1987.Google ScholarCross Ref
- I. MacKenzie and P. Isokoski. Fitts throughput and the speed-accuracy tradeoff. In Proc. of ACM CHI, pages 1633--1636, 2008. Google ScholarDigital Library
- S. Mann. Intelligent Image Processing. John Wiley and Sons, 2001. Google ScholarDigital Library
- J. McLester and P. S. Pierre. Applied Biomechanics: Concepts and Connections. Cengage Learning, 2007.Google Scholar
- M. Mine, F. B. Jr, and C. Sequin. Moving Objects in Space: Exploiting Proprioception in Virtual-Environment interaction. In Proc. of ACM SIGGRAPH, pages 19--26, 1997. Google ScholarDigital Library
- A. Murata and H. Iwase. Extending Fitts' Law to a three-dimensional pointing task. Human Movement Science, 20:791--805, 2001.Google ScholarCross Ref
- I. Poupyrev, M. Billinghurst, S. Weghorst, and T. Ichikawa. The Go-Go Interaction Technique: Non-Linear Mapping for Direct Manipulation in VR. In Proc. of ACM UIST, pages 79--80, 1996. Google ScholarDigital Library
- I. Poupyrev, S. Weghorst, M. Billinghurst, and T. Ichikawa. A framework and testbed for studying manipulation techniques for immersive vr. In Proc. of ACM VRST, pages 21--28, 1997. Google ScholarDigital Library
- M. Sanders and E. McCormick. Human Factors in Engineering and Design. McGRAW-HILL Book Company, 1987.Google Scholar
- G. Shoemaker, T. Tsukitani, Y. Kitamura, and K. S. Booth. Two-Part Models Capture the Impact of Gain on Pointing Performance. ACM Trans. Comput.-Hum. Interact., 19(4):28:1--28:34, Dec. 2012. Google ScholarDigital Library
- J. A. Thomson. Is continuous visual monitoring necessary in visually guided locomotion? Journal Experimental Psychology Human Perception Performance, 9(3):427--443, 1983.Google ScholarCross Ref
- M. Usoh, E. Catena, S. Arman, and M. Slater. Using Presence Questionaires in Reality. Presence: Teleoperators & Virtual Environments, 9(5):497--503, 1999. Google ScholarDigital Library
- Y. Wang and C. MacKenzie. Effects of orientation disparity between haptic and graphic displays of objects in virtual environments. Proc. of INTERACT, 99:391--398, 1999.Google Scholar
- P. Willemsen, M. Colton, S. Creem-Regehr, and W. Thompson. The Effects of Head-Mounted Display Mechanical Properties and Field-of-View on Distance Judgments in Virtual Environments. ACM Transactions on Applied Perception (TAP), 2(6):1--14, 2009. Google ScholarDigital Library
- P. Willemsen, A. Gooch, W. Thompson, and S. Creem-Regehr. Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments. Presence: Teleoperators & Virtual Environments, 17(1):91--101, 2008. Google ScholarDigital Library
- C. Wingrave and D. Bowman. Baseline factors for raycasting selection. In Proc. of HCI International, pages 1--10, 2005.Google Scholar
Index Terms
- Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction
Recommendations
Stepping off a ledge in an HMD-based immersive virtual environment
SAP '13: Proceedings of the ACM Symposium on Applied PerceptionWe explore whether a gender-matched, calibrated self-avatar affects the perception of the affordance of stepping off of a ledge, or visual cliff, in an immersive virtual environment. Visual cliffs form demonstrations in many immersive virtual ...
Touching the Third Dimension
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and SurfacesNatural interaction offers the user a great immersive experience and research has shown that especially multi-touch is easier to learn and utilize than classic human-computer interfaces, such as the keyboard and the mouse. However, creating 3D user ...
Inducing Body-Transfer Illusions in VR by Providing Brief Phases of Visual-Tactile Stimulation
SUI '16: Proceedings of the 2016 Symposium on Spatial User InteractionCurrent developments in the area of virtual reality (VR) allow numerous users to experience immersive virtual environments (VEs) in a broad range of application fields. In the same way, some research has shown novel advances in wearable devices to ...
Comments