Abstract
Evaluating surgical skill is a time consuming, subjective, and difficult process. This paper compares two methods of identifying the skill level of a subject given motion data from a benchtop surgical task. In the first method, we build discrete Hidden Markov Models at the task level, and test against these models. In the second method, we build discrete Hidden Markov Models of surgical gestures, called surgemes, and evaluate skill at this level. We apply these techniques to 57 data sets collected from the da Vinci surgical system. Our current techniques have achieved accuracy levels of 100% using task level models and known gesture segmentation, 95% with task level models and unknown gesture segmentation, and 100% with the surgeme level models in correctly identifying the skill level. We observe that, although less accurate, the second method requires less prior label information. Also, the surgeme level classification provided more insights into what subjects did well, and what they did poorly.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Moorthy, K., Munz, Y., Dosis, A., Hernandez, J., Martin, S., Bello, F., Rockall, T., Darzi, A.: Dexterity enhancement with robotic surgery. Surg. Endo. 18, 790–795 (2004)
Reznick, R., MacRae, H.: Teaching surgical skills-changes in the wind. New England Journal of Medicine 355(25), 2664–2669 (2006)
Xin, H., Zelek, J.S., Carnahan, H.: Laparoscopic surgery, perceptual limitations and force: A review. In: First Joint Eurohaptics Conf. and Symp. on Haptic Interfaces for Virtual Environment (2006)
Business, G.S.: Computer assisted surgical systems. A Global Strategic Business Report (2007)
Rabiner, L.: A tutorial on hidden markov models and selected applications in speech recognition. IEEE 77(2), 257–286 (1989)
Yang, J., Xu, Y., Chen, M.: Hidden markov model approach to skill learning and its application to telerobotics. Technical report, Robotics Institute, Carnegie Mellon University (1993)
Hannaford, B., Lee, P.: Hidden markov model analysis of force/torque information in telemanipulation. Int. Journal of Robotics Research 10(5), 528–539 (1991)
Hovland, G., Sikka, P., McCarragher, B.: Skill acquisition from human demonstration using a hidden markov model. Int. Conf. on Rob. Automat. 10(5), 528–539 (1996)
Yu, W., Dubey, R., Pernalete, N.: Robotic therapy for persons with disabilities using hidden markov model based skill learning. In: IEEE Int. Conf. on Rob. Automat., pp. 2074–2079 (2004)
Rosen, J., Brown, J.D., Chang, L., Hannaford, M.N.S.B.: Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete markov model. IEEE Trans. in. Bio. Eng. 53(3), 399–413 (2006)
Murphy, T.E., Vignes, C.M., Yuh, D.D., Okamura, A.: Automatic motion recognition and skill evaluation for dynamic tasks. In: Eurohaptics, pp. 363–373 (2003)
Megali, G., Sinigaglia, S., Tonet, O., Dario, P.: Modelling and evaluation of surgical performance using hidden markov models. IEEE Trans. on Bio. Eng. 53(10), 1911–1919 (2006)
Lin, H.C., Shafran, I., Yuh, D.D., Hager, G.D.: Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions. Comp. Aid. Surg. 11(5), 220–223 (2006)
Cao, C.G., MacKenzie, R.D., Payandeh, S.: Task and motion analyses in endoscopic surgery. ASME IMECE, 583–590 (1996)
Guthart, G.S., Salisbury, J.K.: The intuitivetm telesurgery system: Overview and application. In: IEEE Int. Conf. on Rob. Automat., pp. 618–621 (2000)
Hartigan, J.A., Wong, M.A.: A k-means clustering algorithm. Applied Statistics 8(1), 100–108 (1979)
Matlab: Statistics and pattern recognition toolkit
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Electronic Supplementary Material
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Reiley, C.E., Hager, G.D. (2009). Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery. In: Yang, GZ., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009. MICCAI 2009. Lecture Notes in Computer Science, vol 5761. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04268-3_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-04268-3_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04267-6
Online ISBN: 978-3-642-04268-3
eBook Packages: Computer ScienceComputer Science (R0)