HyeonBeom Yi
Jiwoo Hong
ABSTRACT
We present DexController, which is a hand-held controller leveraging grasp as an additional modality for virtual reality (VR) game. The pressure-sensitive surface of DexController was designed to recognize two different grasp-poses (i.e. precision grip and power grip) and detect grasp-force. Based on the results of two feasibility tests, a VR defense game was designed in which players could attack each enemy using the proper weapon with a proper level of force. A within-subject comparative study is conducted with a button-based controller which has the same physical form of DexController. The results indicated that DexController enhanced the perceived naturalness of the controller and game enjoyment, with having acceptable physical demand. This study clarifies the empirical effect of utilizing grasp-recognition on VR game controller to enhance interactivity. Also, we provide insight for the integration of VR game elements with the grasping modality of a controller.
Supplemental Material
- Mohd Hezri Amir, Albert Quek, Nur Rasyid Bin Sulaiman, and John See. 2016. DUKE: Enhancing Virtual Reality based FPS Game with Full-body Interactions. Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology - ACE2016: 1–6. https://doi.org/10.1145/3001773.3001804Google Scholar
Digital Library
- Frank Biocca. 1992. Virtual Reality Technology: A Tutorial. Journal of Communication 42, 4: 23–72. https://doi.org/10.1111/j.1460-2466.1992.tb00811.xGoogle ScholarCross Ref
- Charles Adison Bouman. 2014. Connected Neighbors. Processing, Digital Image: 1–19.Google Scholar
- Inrak Choi and Sean Follmer. 2016. Wolverine: A Wearable Haptic Interface for Grasping in VR. Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST ’16 Adjunct: 117–119. https://doi.org/10.1145/2984751.2985725Google ScholarDigital Library
- Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. Claw. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18: 1–13. https://doi.org/10.1145/3173574.3174228Google ScholarDigital Library
- Ka Weng Chou, Albert Quek, and Hui Hong Yew. 2018. Onmyouji : Gesture-based virtual reality game. 7: 110–113.Google Scholar
- Thomas Feix, Roland Pawlik, Heinz-Bodo Schmiedmayer, Javier Romero, and Danica Kragi. 2008. A comprehensive grasp taxonomy LEGEND. Archives of Physical Medicine and Rehabilitation, Iberall 1997: 2–4.Google Scholar
- Nobuhiro Funato and Kentaro Takemura. 2017. Grip Force Estimation by Emitting Vibration. 141–142. https://doi.org/10.1145/3131785.3131829Google ScholarDigital Library
- Mayank Goel, Jacob O Wobbrock, and Shwetak N Patel. 2012. GripSense. Proceedings of the 25th annual ACM symposium on User interface software and technology - UIST ’12: 545. https://doi.org/10.1145/2380116.2380184Google ScholarDigital Library
- Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9: 904–908. https://doi.org/10.1177/154193120605000909Google ScholarCross Ref
- Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In (UIST ’18 (accepted)).Google Scholar
- Gang Hu, Nabil Bin Hannan, Khalid Tearo, Arthur Bastos, and Derek Reilly. 2016. Doing while thinking: Physical and cognitive engagement and immersion in mixed reality games. DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse: 947–958. https://doi.org/10.1145/2901790.2901864Google ScholarDigital Library
- W.a. IJsselsteijn, Y.a.W. de Kort, and K. Poels. 2013. Game Experience Questionnaire. 1–9. https://doi.org/10.1016/B978-008045089-6.50026-5Google Scholar
- Michael Katzourin, Daniel Ignatoff, Lincoln Quirk, Joseph J. LaViola, and Odest Chadwicke Jenkins. 2006. Swordplay: Innovating game development through VR. IEEE Computer Graphics and Applications 26, 6: 15–19. https://doi.org/10.1109/MCG.2006.137Google ScholarDigital Library
- Han-Jong Kim, Jeijin Cha, Richard Chulwoo Park, Tek-Jin Nam, Woohun Lee, and Geehyuk Lee. 2016. Mo-Bi: Contextual Mobile Interfaces through Bimanual Posture Sensing with Wrist-Worn Devices. HCI Korea 2016: 94–99. https://doi.org/10.17210/hcik.2016.01.94Google ScholarDigital Library
- Anthony M. Limperos, Michael G. Schmierbach, Andrew D. Kegerise, and Frank E. Dardis. 2011. Gaming Across Different Consoles: Exploring the Influence of Control Scheme on Game-Player Enjoyment. Cyberpsychology, Behavior, and Social Networking 14, 6: 345–350. https://doi.org/10.1089/cyber.2010.0146Google ScholarCross Ref
- Rory MacGloin and Marina Krcmar. 2011. The impact of Controller naturalness on Spatial Presence, Gamer Enjoyment, and Perceived Realism in a Tennis Simulation Video Game. Plant Disease IV, May 2014: 273–292. https://doi.org/10.1162/PRESGoogle ScholarCross Ref
- Christine L MacKenzie and Thea Iberall. 1994. The grasping hand. Elsevier.Google Scholar
- Jon Moeller. N.A. DIY Pressure Sensitive Floors for Expressive Interaction.Google Scholar
- Amir Mohd Hezri, Albert Quek, Sulaiman Nur Rasyid Bin, and See John. 2016. Duke : Enhancing Virtual Reality based FPS Game with Full-body Interactions. Notes and Queries s9-IX, 226: 329. https://doi.org/10.1093/nq/s9-IX.226.329-dGoogle Scholar
- Matei Negulescu and Joanna McGrenere. 2015. Grip Change as an Information Side Channel for Mobile Touch Interaction. Proceedings of the ACM CHI’15 Conference on Human Factors in Computing Systems 1: 1519–1522. https://doi.org/10.1145/2702123.2702185Google ScholarDigital Library
- Donald A Norman. 2002. The Design of Everyday Things. Basic Books, Inc., New York, NY, USA.Google ScholarDigital Library
- Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. Proceedings of the 26th annual ACM symposium on User interface software and technology: 31–40. https://doi.org/10.1145/2501988.2501989Google ScholarDigital Library
- Leigh Ellen Potter, Jake Araullo, and Lewis Carter. 2013. The Leap Motion Controller: A View on Sign Language. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI ’13), 175–178. https://doi.org/10.1145/2541016.2541072Google ScholarDigital Library
- John R Napier. 2005. 3. The prehensile movements of the hand. 1–12. https://doi.org/10.1302/0301-620X.38B4.902Google Scholar
- Ryan Rogers, Nicholas David Bowman, and Mary Beth Oliver. 2015. It's not the model that doesn't fit, it's the controller! the role of cognitive skills in understanding the links between natural mapping, performance, and enjoyment of console video games. Computers in Human Behavior 49: 588–596. https://doi.org/10.1016/j.chb.2015.03.027Google ScholarDigital Library
- Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12), c: 483–492. https://doi.org/10.1145/2207676.2207743Google ScholarDigital Library
- Jonmichael Seibert. 2017. Control mapping in virtual reality : effects on spatial presence and controller naturalness. Virtual Reality, February 2018. https://doi.org/10.1007/s10055-017-0316-1Google ScholarDigital Library
- Adwait Sharma, Joan Sol Roo, and Jürgen Steimle. 2019. Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, Chi: 13. https://doi.org/10.1145/3290605.3300632Google ScholarDigital Library
- Paul Skalski, Ron Tamborini, Ashleigh Shelton, Michael Buncher, and Pete Lindmark. 2011. Mapping the road to fun: Natural video game controllers, presence, and game enjoyment. New Media & Society 13, 2: 224–242. https://doi.org/10.1177/1461444810370949Google ScholarCross Ref
- Hyunyoung Song, Hrvoje Benko, Francois Guimbretiere, Shahram Izadi, Xiang Cao, and Ken Hinckley. 2011. Grips and gestures on a multi-touch pen. Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11: 1323. https://doi.org/10.1145/1978942.1979138Google ScholarDigital Library
- Misha Sra, Xuhai Xu, and Pattie Maes. 2018. BreathVR. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18: 1–12. https://doi.org/10.1145/3173574.3173914Google ScholarDigital Library
- Jonathan Steuer. 1992. Defining Virtual Reality: Dimensions Determing Telepresence. Journal of Communication 42, 4: 73–93.Google ScholarCross Ref
- Ron Tamborini and Nicholas D. Bowman. 2010. Presence in Video Games. Immersed in media: Telepresence in everyday life, October: 87–109.Google Scholar
- Brandon T. Taylor and V. Michael Bove. 2009. Graspables: Grasp-recognition as a user interface. Proceedings of the 27th international conference on Human factors in computing systems - CHI 09 17, 1: 917. https://doi.org/10.1145/1518701.1518842Google ScholarDigital Library
- Raphael Wimmer. 2011. Grasp sensing for human-computer interaction. Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction - TEI ’11: 221. https://doi.org/10.1145/1935701.1935745Google ScholarDigital Library
- Werner Wirth, Tilo Hartmann, Saskia Böcking, Peter Vorderer, Christoph Klimmt, Holger Schramm, Timo Saari, Jari Laarni, Niklas Ravaja, Feliz Ribeiro Gouveia, Frank Biocca, Ana Sacau, Lutz Jäncke, Thomas Baumgartner, and Petra Jäncke. 2007. A process model of the formation of spatial presence experiences. Media Psychology 9, 3: 493–525. https://doi.org/10.1080/15213260701283079Google ScholarCross Ref
- Soojeong Yoo. 2018. VRmove : Design Framework for Balancing Enjoyment, Movement and Exertion in VR Games. 295–307.Google Scholar
- Dongwook Yoon, Ken Hinckley, Hrvoje Benko, François Guimbretière, Pourang Irani, Michel Pahud, and Marcel Gavriliu. 2015. Sensing Tablet Grasp + Micro-mobility for Active Reading. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15: 477–487. https://doi.org/10.1145/2807442.2807510Google ScholarDigital Library
- Valve Corporation. 2018. Steam Community Guide Knuckles EV3 What's New. Retrieved from https://steamcommunity.com/sharedfiles/filedetails/?id=1508356684Google Scholar
Recommendations
SpinOcchio: Understanding Haptic-Visual Congruency of Skin-Slip in VR with a Dynamic Grip Controller
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsThis paper’s goal is to understand the haptic-visual congruency perception of skin-slip on the fingertips given visual cues in Virtual Reality (VR). We developed SpinOcchio (Spin for the spinning mechanism used, Occhio for the Italian word “eye”), a ...
DexController : Hand-Held Controller Recognizing Grasp-Pose and Grasp-Force in Virtual Reality Defense Game
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and TechnologyWe developed a hand-held controller named DexController, leveraging grasp as an additional input modality for virtual reality(VR) game. The pressure-sensitive surface of DexController could recognize two different grasp-poses (i.e. precision grip and ...
Player Experience in a VR and Non-VR Multiplayer Game
VRIC '18: Proceedings of the Virtual Reality International Conference - Laval VirtualSeveral studies compared the player experience of Virtual Reality (VR) games and non-VR games. However, there is a lack of research on the specific subject of VR and non-VR multiplayer games. Therefore, this work explores how implementing a multiplayer ...
Comments