ABSTRACT
Three-dimensional (3D) models have widely been used in medical diagnosis and planning tasks. Haptic virtual reality (VR) interfaces implemented by using VR equipment and haptic devices have previously been proposed for these medical 3D manipulation tasks. They have been found to be faster and more accurate in a medical marking task with novel users, compared with the traditional 2D interaction technique that uses a mouse and a 2D display. In this study, we recruited medical experts who do the medical landmarking task as part of their daily work to examine the performance of haptic VR interfaces and to investigate experts’ user experience. There were no statistically significant differences between the haptic user interfaces and the mouse-based 2D interface in terms of task completion time and marking accuracy. Based on experts’ subjective data, haptic VR interfaces showed great potential for medical work because of the natural input methods and haptic feedback.
Supplemental Material
- 3DSystems 2020. How to Buy Haptics. 3DSystems. Retrieved Oct 19, 2020 from https://www.3dsystems.com/how-to-buy/hapticsGoogle Scholar
- Ragnar Bade, Felix Ritter, and Bernhard Preim. 2005. Usability Comparison of Mouse-Based Interaction Techniques for Predictable 3d Rotation. In Smart Graphics, Andreas Butz, Brian Fisher, Antonio Krüger, and Patrick Olivier (Eds.). Springer, Springer Berlin Heidelberg, Berlin, Heidelberg, 138–150. https://doi.org/10.1007/11536482_12Google Scholar
- Lonni Besançon, Paul Issartel, Mehdi Ammi, and Tobias Isenberg. 2017. Mouse, Tactile, and Tangible Input for 3D Manipulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4727–4740. https://doi.org/10.1145/3025453.3025863Google ScholarDigital Library
- W Bholsithi, W Tharanon, K Chintakanon, R Komolpis, and C Sinthanayothin. 2009. 3D vs. 2D cephalometric analysis comparisons with repeated measurements from 20 Thai males and 20 Thai females. Biomedical imaging and intervention journal 5, 4 (2009), e21.Google Scholar
- Doug Bowman, Ernst Kruijff, Joseph J LaViola Jr, and Ivan P Poupyrev. 2004. 3D User Interfaces, Theory and Practice. Addison-Wesley Professional, Boston, MA.Google Scholar
- Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A Study in Interactive 3-D Rotation Using 2-D Control Devices. In Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’88). Association for Computing Machinery, New York, NY, USA, 121–129. https://doi.org/10.1145/54852.378497Google ScholarDigital Library
- Luigi Gallo, Aniello Minutolo, and Giuseppe De Pietro. 2010. A user interface for VR-ready 3D medical imaging by off-the-shelf input devices. Computers in Biology and Medicine 40, 3 (2010), 350–358.Google ScholarDigital Library
- Ken Hinckley, Joe Tullio, Randy Pausch, Dennis Proffitt, and Neal Kassell. 1997. Usability Analysis of 3D Rotation Techniques. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (Banff, Alberta, Canada) (UIST ’97). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/263407.263408Google ScholarDigital Library
- Akitoshi Katsumata, Masami Fujishita, Masahito Maeda, Yoshiko Ariji, Eiichiro Ariji, and Robert P. Langlais. 2005. 3D-CT evaluation of facial asymmetry. Oral Surgery, Oral Medicine, Oral Pathology, Oral Radiology, and Endodontology 99, 2(2005), 212 – 220. https://doi.org/10.1016/j.tripleo.2004.06.072Google Scholar
- Katherine Kula and Ahmed Ghoneima. 2018. Cephalometry in Orthodontics: 2D and 3D. Quintessence Publishing Company, Incorporated, New Malden, England.Google Scholar
- Zhenxing Li, Maria Kiiveri, Jussi Rantala, and Roope Raisamo. 2020. Evaluation of haptic virtual reality user interfaces for medical marking on 3D models. International Journal of Human-Computer Studies 147, 102561(2020), 102561. https://doi.org/10.1016/j.ijhcs.2020.102561Google ScholarCross Ref
- Claudia Lindner, Ching-Wei Wang, Cheng-Ta Huang, Chung-Hsing Li, Sheng-Wei Chang, and Tim F Cootes. 2016. Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms. Scientific reports 6(2016), 33581. https://doi.org/10.1038/srep33581Google Scholar
- Hugo I Medellín-Castillo, Eder H Govea-Valladares, CN Pérez-Guerrero, J Gil-Valladares, Theodore Lim, and James M Ritchie. 2016. The evaluation of a novel haptic-enabled virtual reality approach for computer-aided cephalometry. Computer Methods and Programs in Biomedicine 130 (2016), 46–53. https://doi.org/10.1016/j.cmpb.2016.03.014Google ScholarDigital Library
- Raphaël Olszewski, Francis Zech, Guy Cosnard, Vincent Nicolas, Benoit Macq, and Hervé Reychler. 2007. Three-dimensional computed tomography cephalometric craniofacial analysis: experimental validation in vitro. International Journal of Oral and Maxillofacial Surgery 36, 9(2007), 828 – 833. https://doi.org/10.1016/j.ijom.2007.05.022Google ScholarCross Ref
- Ken Shoemake. 1992. ARCBALL: a User Interface for Specifying Three-Dimensional Orientation Using a Mouse. In Proceedings of Graphics interface’92 (Vancouver, British Columbia, Canada) (GI ’92). Canadian Human-Computer Communications Society, Toronto, Ontario, Canada, 151–156. https://doi.org/10.20380/GI1992.18Google Scholar
- Steam 2020. SteamVR. Steam. Retrieved Oct 19, 2020 from https://store.steampowered.com/app/250820/SteamVR/Google Scholar
- David Sutton. 1993. Textbook of Radiology and Imaging. Churchill Livingstone Inc., New York, NY.Google Scholar
- GR Swennen and F Schutyser. 2007. Three-dimensional virtual approach to diagnosis and treatment planning of maxillo-facial deformity. Distraction osteogenesis of the facial skeleton 6 (2007), 55–79.Google Scholar
- Unity 2020. Unity Software. Unity. Retrieved Oct 19, 2020 from https://unity.com/Google Scholar
- Unity 2020. Unity Haptic plugin. Unity. Retrieved Oct 19, 2020 from https://assetstore.unity.com/packages/essentials/tutorial-projects/unity-5-haptic-plugin-for-geomagic-openhaptics-3-3-hlapi-hdapi-34393Google Scholar
- O.J.C. van Vlijmen, T. Maal, S.J. Bergé, E.M. Bronkhorst, C. Katsaros, and A.M. Kuijpers-Jagtman. 2010. A comparison between 2D and 3D cephalometry on CBCT scans of human skulls. International Journal of Oral and Maxillofacial Surgery 39, 2(2010), 156 – 160. https://doi.org/10.1016/j.ijom.2009.11.017Google ScholarCross Ref
- HTC 2020. HTC Vive VR. HTC. Retrieved Oct 19, 2020 from https://www.vive.com/eu/Google Scholar
- Lingyun Yu, Pjotr Svetachov, Petra Isenberg, Maarten H Everts, and Tobias Isenberg. 2010. FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces. IEEE Transactions on Visualization and Computer Graphics 16, 6(2010), 1613–1622. https://doi.org/10.1109/TVCG.2010.157Google ScholarDigital Library
Recommendations
Envisioning Haptic Design for Immersive Virtual Environments
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems ConferenceCurrent techniques for haptics in immersive virtual environments (IVEs) allow users to perceive materials while exploring virtual surfaces. However, these experiences are usually restricted to the properties defined during the design phase of the IVE. ...
A Preliminary Study on Full-Body Haptic Stimulation on Modulating Self-motion Perception in Virtual Reality
Augmented Reality, Virtual Reality, and Computer GraphicsAbstractWe introduce a novel experimental system to explore the role of vibrotactile haptic feedback in Virtual Reality (VR) to induce the self-motion illusion. Self-motion (also called vection) has been mostly studied through visual and auditory stimuli ...
Haptic Fidelity Framework: Defining the Factors of Realistic Haptic Feedback for Virtual Reality
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsProviding haptic feedback in virtual reality to make the experience more realistic has become a strong focus of research in recent years. The resulting haptic feedback systems differ greatly in their technologies, feedback possibilities, and overall ...
Comments