Abstract
It is well understood that multi-sensory stimulation can be used to enhance immersion in virtual environments such as Virtual Reality (VR) and Augmented Reality (AR). State of the art VR technologies have enhanced visual stimulation in aspects such as pixel density in recent years, whilst the area of haptics has remained less developed. The Ultrahaptics Evaluation Kit is a relatively new technology that consists of a \(16\times 16\) array of ultrasound transducers used to create ultrasound haptic sensations. We have developed a proof of concept large scale haptic system by integrating this device with an HTC VIVE, Leap Motion and Rethink Robotics’ Baxter Robot to provide ultrasound haptic feedback in a volume greater than 1.5 m\(^3\) for VR users. The system was evaluated through a user study with 19 participants. The study focused on users’ assessments of the location of the haptics produced by the system. The results of the study offer a means of validating the system, as well as providing comparisons in accuracy for a haptic perception task vs a visual perception task. There have been opportunities recognised for improving accuracy of the system. However, the system has been deemed suitable in creating haptic feedback for low fidelity models within large volumes in VR.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Blake, J., Gurocak, H.B.: Haptic glove with mr brakes for virtual reality. IEEE/ASME Trans. Mechatron. 14(5), 606–615 (2009). https://doi.org/10.1109/TMECH.2008.2010934
Brice, D., Devine, S., Rafferty, K.: A novel force feedback haptics system with applications in phobia treatment (2017)
Carter, T., Seah, S., Long, B., Drinkwater, B., Subramanian, S.: Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces. In: UIST 2013 Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013. Association for Computing Machinery (ACM), October 2013. https://doi.org/10.1145/2501988.2502018
Corbett-Davies, S., Dünser, A., Clark, A.: Interactive AR exposure therapy. In: Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction, CHINZ 2012, p. 98. ACM, New York (2012). https://doi.org/10.1145/2379256.2379282
Covarrubias, M., Bordegoni, M.: Immersive VR for natural interaction with a haptic interface for shape rendering. In: 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a Better Tomorrow (RTSI), pp. 82–89, September 2015. https://doi.org/10.1109/RTSI.2015.7325075
Cremer, S., Mastromoro, L., Popa, D.O.: On the performance of the Baxter research robot. In: 2016 IEEE International Symposium on Assembly and Manufacturing (ISAM), pp. 106–111, August 2016. https://doi.org/10.1109/ISAM.2016.7750722
Dexmo: Dexmo (2008). http://www.dextarobotics.com/. Accessed 14 Feb 2018
Dunbar, B., et al.: Augmenting human spatial navigation via sensory substitution. In: 2017 IEEE MIT Undergraduate Research Technology Conference (URTC), pp. 1–4, November 2017. https://doi.org/10.1109/URTC.2017.8284172
Garage, W.: MoveIt (2008). http://moveit.ros.org/. Accessed 14 Feb 2018
Geomagic: Phantom Omni (2011). http://www.geomagic.com/en/products/phantom-omni/overview. Accessed 14 Feb 2018
Guo, J., Guo, S.: A haptic interface design for a VR-based unskilled doctor training system in vascular interventional surgery. In: 2014 IEEE International Conference on Mechatronics and Automation, pp. 1259–1263, August 2014. https://doi.org/10.1109/ICMA.2014.6885880
Han, P.H., et al.: OoEs: playing in the immersive game with augmented haptics. In: ACM SIGGRAPH 2016 VR Village, SIGGRAPH 2016, p. 15:1. ACM, New York (2016). https://doi.org/10.1145/2929490.2929895
Hoshi, T., Takahashi, M., Iwamoto, T., Shinoda, H.: Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans. Haptics 3(3), 155–165 (2010). https://doi.org/10.1109/TOH.2010.4
HTC: HTC Vive (2011). https://www.vive.com/uk/. Accessed 14 Feb 2018
Iwamoto, T., Tatezono, M., Shinoda, H.: Non-contact method for producing tactile sensation using airborne ultrasound. In: Ferre, M. (ed.) EuroHaptics 2008. LNCS, vol. 5024, pp. 504–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69057-3_64
de Jesus Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Experiencing guidance in 3D spaces with a vibrotactile head-mounted display. In: 2017 IEEE Virtual Reality (VR), pp. 453–454, March 2017. https://doi.org/10.1109/VR.2017.7892375
Knopp, S., Lorenz, M., Pelliccia, L., Klimant, P.: Using industrial robots as haptic devices for VR-training. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 607–608, March 2018. https://doi.org/10.1109/VR.2018.8446614
Long, B., Seah, S.A., Carter, T., Subramanian, S.: Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans. Graph. 33(6), 181:1–181:10 (2014). https://doi.org/10.1145/2661229.2661257
Ma, Z., Ben-Tzvi, P.: RML glove–an exoskeleton glove mechanism with haptics feedback. IEEE/ASME Trans. Mechatron. 20(2), 641–652 (2015). https://doi.org/10.1109/TMECH.2014.2305842
Martínez, J., García, A., Oliver, M., Molina, J.P., González, P.: Identifying virtual 3D geometric shapes with a vibrotactile glove. IEEE Comput. Graph. Appl. 36(1), 42–51 (2016). https://doi.org/10.1109/MCG.2014.81
Motion, L.: Leap Motion (2008). https://www.leapmotion.com/. Accessed 12 June 2018
Neupert, C., Matich, S., Scherping, N., Kupnik, M., Werthschützky, R., Hatzfeld, C.: Pseudo-haptic feedback in teleoperation. IEEE Trans. Haptics 9(3), 397–408 (2016). https://doi.org/10.1109/TOH.2016.2557331
Peng, W., Xiao, N., Guo, S., Wang, Y.: A novel force feedback interventional surgery robotic system. In: 2015 IEEE International Conference on Mechatronics and Automation (ICMA), pp. 709–714, August 2015. https://doi.org/10.1109/ICMA.2015.7237572
de Ribaupierre, S., Eagleson, R.: Editorial: challenges for the usability of AR and VR for clinical neurosurgical procedures. Healthc. Technol. Lett. 4(5), 151–151 (2017). https://doi.org/10.1049/htl.2017.0077
Rethink Robotics: Baxter specifications (2008). http://www.rethinkrobotics.com/baxter/tech-specs/. Accessed 14 Feb 2018
Sodhi, R., Poupyrev, I., Glisson, M., Israr, A.: AIREAL: interactive tactile experiences in free air. ACM Trans. Graph. 32(4), 134:1–134:10 (2013). https://doi.org/10.1145/2461912.2462007
Strickland, D., Hodges, L., North, M., Weghorst, S.: Overcoming phobias by virtual exposure. Commun. ACM 40(8), 34–39 (1997). https://doi.org/10.1145/257874.257881
Suzuki, Y., Kobayashi, M.: Air jet driven force feedback in virtual reality. IEEE Comput. Graph. Appl. 25(1), 44–47 (2005). https://doi.org/10.1109/MCG.2005.1
Thanh, V.D.H., Pui, O., Constable, M.: Room VR: A VR therapy game for children who fear the dark. In: SIGGRAPH Asia 2017 Posters, SA 2017, pp. 52:1–52:2. ACM, New York (2017). https://doi.org/10.1145/3145690.3145734
Tsai, W.L.: Personal basketball coach: tactic training through wireless virtual reality. In: Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval, ICMR 2018, pp. 481–484. ACM, New York (2018). https://doi.org/10.1145/3206025.3206084
Ultrahaptics: Ultrahaptics technical white paper. Technical report, Bristo, l United Kingdom (2018)
van Wyk, E., de Villiers, R.: Virtual reality training applications for the mining industry. In: Proceedings of the 6th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, AFRIGRAPH 2009, pp. 53–63. ACM, New York (2009). https://doi.org/10.1145/1503454.1503465
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Brice, D., McRoberts, T., Rafferty, K. (2019). A Proof of Concept Integrated Multi-systems Approach for Large Scale Tactile Feedback in VR. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11613. Springer, Cham. https://doi.org/10.1007/978-3-030-25965-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-25965-5_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25964-8
Online ISBN: 978-3-030-25965-5
eBook Packages: Computer ScienceComputer Science (R0)