Abstract
The aims of this study were to test the face, content, and construct validities of a virtual-reality haptic arthroscopy simulator and to validate four assessment hypothesis. The participants in our study were 94 arthroscopists attending an international conference on arthroscopy. The interviewed surgeons had been performing arthroscopies for a mean of 8.71 years (σ = 6.94 years). We explained the operation, functionality, instructions for use, and the exercises provided by the simulator. They performed a trial exercise and then an exercise in which performance was recorded. After having using it, the arthroscopists answered a questionnaire. The simulator was classified as one of the best training methods (over phantoms), and obtained a mark of 7.10 out of 10 as an evaluation tool. The simulator was considered more useful for inexperienced surgeons than for surgeons with experience (mean difference 1.88 out of 10, P value < 0.001). The participants valued the simulator at 8.24 as a tool for learning skills, its fidelity at 7.41, the quality of the platform at 7.54, and the content of the exercises at 7.09. It obtained a global score of 7.82. Of the subjects, 30.8% said they would practise with the simulator more than 6 h per week. Of the surgeons, 89.4% affirmed that they would recommend the simulator to their colleagues. The data gathered support the first three hypotheses, as well as face and content validities. Results show statistically significant differences between experts and novices, thus supporting the construct validity, but studies with a larger sample must be carried out to verify this. We propose concrete solutions and an equation to calculate economy of movement. Analogously, we analyze competence measurements and propose an equation to provide a single measurement that contains them all and that, according to the surgeons’ criteria, is as reliable as the judgment of experts observing the performance of an apprentice.
Similar content being viewed by others
References
Fernández-Arroyo JM, Espadero JM, Bayona S, Garcia M, Toharia P (2005) Proyecto SARA (Simulador Artroscópico Avanzado). Simuladores en la formación y docencia de la cirugía artroscópica de hombro mediante técnicas de realidad virtual. Span J Res 8(1):13–9
Sutherland LM, Middleton PF, Anthony A, Hamdorf J, Cregan P, Scott D, Maddern GJ (2006) Surgical simulation: a systematic review. Ann Surg 243(3):291–300
Haque S, Srinivasan S (2006) A meta-analysis of the training effectiveness of virtual reality surgical simulators. Comparative study. IEEE Trans Inf Technol Biomed 10(1):51–58
insight ARTHRO VR ®. Web, 2008. www.gmv.com/insight
Bayona S (2007) Metodologías de aprendizaje y evaluación para simuladores quirúrgicos de Realidad Virtual. Aplicación en simuladores artroscópicos (Dissertation). Escuela Técnica Superior de Ingeniería Informática. Universidad Rey Juan Carlos. Madrid. Spain
Bayona S, Espadero JM, Pastor L, Fernández-Arroyo JM (2003) A low-cost arthroscopy surgery training system. IASTED03 VTTP Proc 2:1005–1009
Espadero JM, Bayona S, Fernández-Arroyo JM, Garcia M (2004) Advanced Athroscopy Training Simulator. insightMIST Avances en la Ciencia de la Computación (9):178–187
Fernández-Arroyo JM, Pastor L, Espadero JM, Bayona S, Triviño G (2004) Aplicaciones de técnicas de Realidad Virtual en el aprendizaje artroscópico. Introducción, posibilidades y actualización. Cuadernos de Artroscopia 11(2):8–13
Bayona S, García M, Mendoza C, Fernández-Arroyo JM (2006) Shoulder arthroscopy training system with force feedback. Internacional Conference MediViz06. Med Inf Vis BioMed Vis 7:71–76
San Martin J, Miraut D, Gómez C, Bayona S (2005) Design of an adaptable haptic de device for an arthroscopy training environment. J Inter Des Manufact (IJIDeM) 3804:1–5
Congreso de la Sociedad Española de Artroscopia (AEA) (2007) Sevilla, Spain http://www.aeartroscopia.com/
Acknowledgments
This work has been partially funded by the Spanish Ministry of Education and Science (grant TIN2007-67188) and the Government of the Community of Madrid (grant S-0505/DPI/0235; GATARVISA).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bayona, S., Fernández-Arroyo, J.M., Martín, I. et al. Assessment study of insight ARTHRO VR ® arthroscopy virtual training simulator: face, content, and construct validities. J Robotic Surg 2, 151–158 (2008). https://doi.org/10.1007/s11701-008-0101-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11701-008-0101-y