Abstract
VR Surgery is an immersive virtual reality operating room experience for trainee surgeons in oral and maxillofacial surgery maxillofacial surgery. Using a combination of Oculus Rift head-mounted display, Leap Motion tracking devices, high-resolution stereoscopic 3D videos and 360-degree videos, this application allows a trainee to virtually participate in a surgical procedure and interact with the patient’s anatomy. VR Surgery is highly useful for surgical trainees as a visualisation aid and for senior surgeons as a practice-based learning tool. This chapter discusses the need for reforms in the existing surgical training methods and a brief review on simulation, serious games and virtual reality in surgical training. Following this, the principles of design and development of VR Surgery are presented.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
AAMC: Physician shortages to worsen without increases in residency training. Available at: https://www.aamc.org/download/150584/data/physician_shortages_factsheet.pdf (2010). Accessed 18 Apr 2016
Aggarwal, R., et al.: The simulated operating theatre: Comprehensive training for surgical teams. Qual. Saf. Health Care. 13(suppl 1), i27–i32 (2004)
ASIT: Cost of surgical training. Retrieved April 18, 2016, from http://www.asit.org/news/costofsurgicaltraining (2015)
Bogner, M.S.E.: Human Error in Medicine. Lawrence Erlbaum Associates, Inc, Hillsdale (1994)
Bridges, M., Diamond, D.L.: The financial impact of teaching surgical residents in the operating room. (0002–9610 (Print))
Carson, E.: Digital cadavers: How virtual reality and augmented reality can change anatomy class. Available at: http://www.techrepublic.com/article/digital-cadavers-how-virtual-reality-and-augmented-reality-can-change-anatomy-class/ (2015). Accessed 17 April 2016
Clark, R.E., et al.: The use of cognitive task analysis to improve instructional descriptions of procedures. J. Surg. Res. 173(1), e37–e42 (2012)
de Wit-Zuurendonk, L.D., Oei, S.G.: Serious gaming in women’s health care. BJOG: An Int. J. Obstet. Gynaecol. 118(s3), 17–21 (2011)
Dedy, N.J., et al.: Structured training to improve nontechnical performance of junior surgical residents in the operating room: A randomized controlled trial. Ann. Surg. 263(1), 43–49 (2016)
Evgeniou, E., Loizou, P.: Simulation-based surgical education – Evgeniou – 2012 – ANZ journal of surgery – Wiley online library. ANZ. J. Surg. 83(9), 619–623 (2012)
Fletcher, G., et al.: Rating non-technical skills: developing a behavioural marker system for use in anaesthesia. Cogn. Tech. Work. 6(3), 165–171 (2004)
Geoffrion, R., et al.: Validating a self-confidence scale for surgical trainees. J. Obstet. Gynaecol. Can. 35(4), 355–361 (2013)
Go Pro, H.: 360Heros® announces release of time saving file manager 360CamMan™ software (2014)
Google: Google cardboard (2015)
Graafland, M., et al.: Systematic review of serious games for medical education and surgical skills training. Br. J. Surg. 99(10), 1322–1330 (2012)
Gurusamy, K., et al.: Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. Br. J. Surg. 95(9), 1088–1097 (2008)
Hartle, A., et al.: Can doctors be trained in a 48 hour working week? 2015 (2014)
HTC (2015) HTC Vive hardware. Available at: https://www.vive.com/us/product/ Accessed 25 Jan 2017
Hull, L., et al.: The impact of nontechnical skills on technical performance in surgery: A systematic review. J. Am. Coll. Surg. 214(2), 214–230 (2012)
Huynh-Thu, Q., et al.: The importance of visual attention in improving the 3D-TV viewing experience: Overview and new perspectives. IEEE Trans. Broadcast. 57(2), 421–431 (2011)
Issenberg, B.S., et al.: Simulation technology for health care professional skills training and assessment. JAMA. 282(9), 861–866 (1999)
Issenberg, B.S., et al.: Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review*. Med. Teach. 27(1), 10–28 (2005)
Jackson, C., Gibbin, K.: Per ardua … ‘Training tomorrow’s surgeons using inter alia lessons from aviation. J. R. Soc. Med. 99(11), 554–558 (2006)
Kapralos, B., et al.: An overview of virtual simulation and serious gaming for surgical education and training. Springer Science + Business Media (2014)
Kerr, B., O’Leary, J.P.: The training of the surgeon: Dr. Halsted’s greatest legacy. Am. Surg. 65(11), 1101–1102 (1999)
Kneebone, R.L.: Practice, rehearsal, and performance. JAMA. 302(12), (2009)
Kneebone, R., et al.: Simulation and clinical practice: strengthening the relationship. Med. Educ. 38(10), 1095–1102 (2004)
Kolb, D.A., et al.: Experiential learning theory: Previous research and new directions. Perspect. Think Learn Cogn. Style. 1, 227–247 (2001)
Kolor: Autopano video – practical synchronization – Autopano. Available at: http://www.kolor.com/wiki-en/action/view/Autopano_Video_-_Practical_synchronization?action=view&title=Autopano_Video_-_Practical_synchronization#MOTION_SYNCHRONIZATION (2015). Accessed 12 April 2016
Lave, J., Wenger, E.: Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge (1991)
Leap, M.: Leap Motion controller (2015)
Leap Motion: VR best practices guidelines. Available at: https://developer.leapmotion.com/assets/Leap%20Motion%20VR%20Best%20Practices%20Guidelines.pdf (2015). Accessed 17 April 2016
Li, P.: Cognitive task analysis. OCLC Syst. Serv.: Int. Digit. Libr. Perspect. 21(3), 252–256 (2005)
Luker, K.R., et al.: The use of a cognitive task analysis–based multimedia program to teach surgical decision making in flexor tendon repair. Am. J. Surg. 195(1), 11–15 (2008)
Lyon, P.: A model of teaching and learning in the operating theatre. Med. Educ. 38(12), 1278–1287 (2004)
Meara, J.G., et al.: Global surgery 2030: Evidence and solutions for achieving health, welfare, and economic development. Lancet. 386(9993), 569–624 (2015)
Michael, D.R., Chen, S.L.: Serious Games: Games That Educate, Train, and Inform. Muska & Lipman/Premier-Trade, New York (2005)
Miller, E.R.: Creating 360 degree videos for surgical education. Available at: http://www.medicalrealities.com/creating-360-video-content-for-surgical-education/ (2015). Accessed 12 April 2016
Miloro, M., et al.: Peterson’s Principles of Oral and Maxillofacial Surgery, vol. 1. PMPH-USA, Shelton (2004)
Moorthy, K., et al.: Surgical crisis management skills training and assessment: A stimulation-based approach to enhancing operating room performance. Ann. Surg. 244(1), 139 (2006)
Orzech, N., et al.: A comparison of 2 ex vivo training curricula for advanced laparoscopic skills: a randomized controlled trial. Ann. Surg. 255(5), 833–839 (2012)
Paige, J.T., et al.: High-fidelity, simulation-based, interdisciplinary operating room team training at the point of care. Surgery. 145(2), 138–146 (2009)
Pallace, N.: BioCommunications association. Available at: http://www.bca.org/resources/tips/surgical_photography_tips.html (2014). Accessed 12 April 2016
Patel, A.D., et al.: Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J. Am. Coll. Cardiol. 47(9), 1796–1802 (2006)
Quinn, B.: UK cancer surgery to be live-streamed via virtual reality technology. Available at: http://www.theguardian.com/society/2016/mar/25/uk-cancer-surgery-live-streamed-virtual-reality (2016). Accessed 6 April 2016
Reid, W.M.: Teaching and learning in operating theatres. Available at:http://www.faculty.londondeanery.ac.uk/e-learning/explore-further/teaching_and_learning_in_\break operating_theatres.pdf (2007). Accessed 16 April 2016
Reznick, R.K.: Teaching and testing technical skills. Am. J. Surg. 165(3), 358–361 (1993)
Roberts, N.K., et al.: Capturing the teachable moment: A grounded theory study of verbal teaching interactions in the operating room. Surgery. 151(5), 643–650 (2012)
Rodriguez-Paz, J., et al.: Beyond “see one, do one, teach one”: toward a different training paradigm. Qual. Saf. Health Care. 18(1), 63–68 (2009)
Rousseau, R.: Virtual surgery gets real. Available at: https://medium.com/@Goetz/virtual-surgery-gets-real-221beeac65ea#.o2lwpyixa (2014). Accessed 17 April 2016
Royal College of Surgeons: Taskforce report on the impact of the European Working Time Directive — The Royal College of Surgeons of England 2015 (2014)
Samsung: Samsung Gear VR 2015 (2015)
Sarker, S., Patel, B.: Simulation and surgical training. Int. J. Clin. Pract. 61(12), 2120–2125 (2007)
Satava, R.M., et al.: Surgical competence and surgical proficiency: Definitions, taxonomy, and metrics. J. Am. Coll. Surg. 196(6), 933–937 (2003)
Serjeant, J.: The NHS technology lag cannot go on (2016)
Sturm, L.P., et al.: A systematic review of skills transfer after surgical simulation training. Ann. Surg. 248(2), 166–179 (2008)
Surgery, T.: Home | touch surgery surgical simulator | the virtual surgery App (2015)
Sutherland, L.M., et al.: Surgical simulation. Ann. Surg. 243(3), 291–300 (2006)
Te, Z.: Oculus Rift vs. Morpheus vs. Vive VR. 2015 (2015)
Torkington, J., et al.: The role of simulation in surgical training. Ann. R. Coll. Surg. Engl. 82(2), 88 (2000)
Vinden, C., et al.: Teaching Surgery Takes Time: the impact of surgical education on time in the operating room. Can. J. Surg. 59(2), 87–92 (2016)
Vitish-Sharma, P., et al.: Acquisition of fundamental laparoscopic skills: Is a box really as good as a virtual reality trainer? Int. J. Surg. 9(8), 659–661 (2011)
Vozenilek, J., et al.: See one, do one, teach one: advanced technology in medical education. Acad. Emerg. Med. 11(11), 1149–1154 (2004)
Vr, O.: Oculus-ready PCs (2016)
Wagner, O., et al.: Three-dimensional vision enhances task performance independently of the surgical method. Surg. Endosc. 26(10), 2961–2968 (2012)
Wingfield, L.R., et al.: Cognitive task analysis: Bringing olymbic athlete style training to surgical education. Surg. Innov. 2015. 22(4), 406–417 (2014)
Yule, S., et al.: Non-technical skills for surgeons in the operating room: A review of the literature. Surgery. 139(2), 140–149 (2006)
Acknowledgements
We would like to thank Mr. Edward Miller, a virtual reality consultant from Business Tours UK, who helped in capturing the 360-degree videos at Glasgow Dental Hospital for the VR Surgery project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Pulijala, Y., Ma, M., Ayoub, A. (2017). VR Surgery: Interactive Virtual Reality Application for Training Oral and Maxillofacial Surgeons using Oculus Rift and Leap Motion. In: Ma, M., Oikonomou, A. (eds) Serious Games and Edutainment Applications . Springer, Cham. https://doi.org/10.1007/978-3-319-51645-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-51645-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-51643-1
Online ISBN: 978-3-319-51645-5
eBook Packages: Computer ScienceComputer Science (R0)