Juan David Hincapié-Ramos
Kasim Ozacar
Yoshifumi Kitamura
ABSTRACT
We present GyroWand, a raycasting technique for 3D interactions in self-contained augmented reality (AR) head-mounted displays. Unlike traditional raycasting which requires absolute spatial and rotational tracking of a user's hand or controller to direct the ray, GyroWand relies on the relative rotation values captured by an inertial measurement unit (IMU) on a handheld controller. These values cannot be directly mapped to the ray direction due to the phenomenon of sensor drift and the mismatch between the orientations of the physical controller and the virtual content. To address these challenges GyroWand 1) interprets the relative rotational values using a state machine which includes an anchor, an active, an out-of-sight and a disambiguation state; 2) handles drift by resetting the default rotation when the user moves between the anchor and active states; 3) does not initiate raycasting from the user's hand, but rather from other spatial coordinates (e.g. chin, shoulder, or chest); and 4) provides three new disambiguation mechanisms: Lock&Twist, Lock&Drag, and AutoTwist. In a series of controlled user studies we evaluated the performance and convenience of different GyroWand design parameters. Results show that a ray originating from the user's chin facilitates selection. Results also show that Lock&Twist is faster and more accurate than other disambiguation mechanisms. We conclude with a summary of the lessons learned for the adoption of raycasting in mobile augmented reality head-mounted displays.
- Argelaguet, F. and Andujar, C. 2013. A survey of 3D object selection techniques for virtual environments. Computers & Graphics, 37 (3). Google Scholar
Digital Library
- Borg, G. 1998. Borg's Perceived Exertion and Pain Scales. Human Kinetics.Google Scholar
- Bowman, D.A., Kruijff, E., LaViola Jr, J.J., and Poupyrev, I. 3D user interfaces: theory and practice. Addison-Wesley. 2004. Google ScholarDigital Library
- Bowman, D.A., Wingrave, C.A., Campbell. J.M, and Ly, V.Q. Using Pinch Gloves? for both Natural and Abstract Interaction Techniques in Virtual Environments, In Proc. HCI'01.Google Scholar
- De Haan, G. Koutek, M., Post, FH. IntenSelect: using dynamic object rating for assisting 3D object selection; 2005.Google Scholar
- Ens, B., Hincapié-Ramos, J.D. and Irani, P. 2014. Ethereal planes: a design framework for 2D information space in 3D mixed reality environments. In Proc. SUI '14. ACM. Google ScholarDigital Library
- Epson Moverio, http://www.epson.com/moverioGoogle Scholar
- Forsberg, A., Herndon, K., Zeleznik, R. Aperture based selection for immersive virtual environments. In Proc. UIST '96. ACM. Google ScholarDigital Library
- Grossman, T. and Balakrishnan, R. The design and evaluation of selection techniques for 3D volumetric displays. In Proc. UIST '06. ACM. Google ScholarDigital Library
- Hincapié-Ramos, J.D., Guo, X., Moghadasian, P. and Irani, P. 2014. Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In Proc. CHI '14. ACM. Google ScholarDigital Library
- Hinckley, K., Pausch, R., Goble, J.C., Kassell, NF. A survey of design issues in spatial input. In Proc. UIST '94. Google ScholarDigital Library
- Jota, R., Nacenta, M.A., Jorge, J.A., Carpendale, S., and Greenberg, A. 2010. A comparison of ray pointing techniques for very large displays. In Proc. GI '10. Canadian Information Processing Society, Toronto, Ont., Canada. Google ScholarDigital Library
- Madgwick, S.O., Harrison, A.J. and Vaidyanathan, R. Estimation of IMU and MARG orientation using a gradient descent algorithm. In Proc. ICORR '11. IEEE.Google Scholar
- META SpaceGlassess, https://www.getameta.com/Google Scholar
- Metaio SDK, http://www.metaio.com/products/sdk/Google Scholar
- Microsoft HoloLens, https://www.microsoft.com/microsofthololens/en-usGoogle Scholar
- Mine, M., Frederick Brooks, J., And Sequin,C. 1997. Moving objects in space: exploiting proprioception in virtual environment interaction. In Proc. SIGGRAPH'97. Google ScholarDigital Library
- Mulloni, A. Seichter, H. and Schmalstieg D. Handheld augmented reality indoor navigation with activity-based instructions. In Proc. MobileHCI '11. ACM. Google ScholarDigital Library
- Nakazato, Y., Kanbara, M., Yokoya, N. Wearable augmented reality system using invisible visual markers and an IR camera. In Proc. ISWC'05. IEEE. Google ScholarDigital Library
- Ni, T., McMahan, R. P., and Bowman, D. 2008. Tech-note: rapMenu: remote menu selection using freehand gestural input. In Proc. 3DUI 2008. IEEE. Google ScholarDigital Library
- Olwal, A., Benko, H., Feiner, S. SenseShapes: using statistical geometry for object selection in a multimodal augmented reality system. In: ISMAR '03. IEEE Google ScholarDigital Library
- Olwal, A., Feiner, S. The flexible pointer: an interaction technique for selection in augmented and virtual reality. In Proc. UIST '03. ACM.Google Scholar
- Pierce, JS., Forsberg, A., Conway, MJ., Hong, S., Zeleznik, R., Mine MR. Image plane interaction techniques in 3D immersive environments. In Proc. I3D'97. Google ScholarDigital Library
- Rahman, M., Gustafson, S., Irani, P. and Subramanian, S. Tilt techniques: investigating the dexterity of wrist-based input. In Proc. CHI '09. ACM. Google ScholarDigital Library
- RGBDSLAM, https://openslam.org/rgbdslam.htmlGoogle Scholar
- Sony SmartEyeglass, https://developer.sony.com/devices/ mobile-accessories/smarteyeglass/Google Scholar
- Steed, A. Selection/towards a general model for selection in virtual environments. In Proc. 3DUI'06. IEEE. Google ScholarDigital Library
- Tanriverdi, V., Jacob, RJK, Interacting with eye movements in virtual environments. In Proc. CHI '00, ACM. Google ScholarDigital Library
- Tsandilas, T., Dubois, E. and Raynal, M. 2010. Free-space pointing with constrained hand movements. In Proc. CHI EA '10. ACM. Google ScholarDigital Library
- Ventura, J., Arth, C., Reitmayr, G., Schmalstieg, D., Global Localization from Monocular SLAM on a Mobile Phone, Visualization and Computer Graphics, In Proc. TVCG'14. IEEE.Google Scholar
- Vuforia for Smart EyeWear, https://www.qualcomm.com/ products/vuforiaGoogle Scholar
- Zhou, P., Li, M. and Shen, G. Use it free: instantly knowing your phone attitude. In Proc. MobiCom '14. ACM. Google ScholarDigital Library
Index Terms
- GyroWand: IMU-based Raycasting for Augmented Reality Head-Mounted Displays
Recommendations
Estimation of virtual interpupillary distances for immersive head-mounted displays
APGV '10: Proceedings of the 7th Symposium on Applied Perception in Graphics and VisualizationHead-mounted displays (HMDs) allow users to observe virtual environments (VEs) from an egocentric perspective. In order to present a realistic stereoscopic view, the rendering system has to be adjusted to the characteristics of the HMD, e. g., the ...
Stepping off a ledge in an HMD-based immersive virtual environment
SAP '13: Proceedings of the ACM Symposium on Applied PerceptionWe explore whether a gender-matched, calibrated self-avatar affects the perception of the affordance of stepping off of a ledge, or visual cliff, in an immersive virtual environment. Visual cliffs form demonstrations in many immersive virtual ...
Natural Perspective Projections for Head-Mounted Displays
The display units integrated in today's head-mounted displays (HMDs) provide only a limited field of view (FOV) to the virtual world. In order to present an undistorted view to the virtual environment (VE), the perspective projection used to render the ...
Comments